-- Logs begin at Thu 2022-05-12 16:49:16 UTC, end at Thu 2022-05-12 17:59:14 UTC. -- May 12 17:33:25.552380 dv-cinder-839793-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 17:33:25.560944 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 17:33:25 2022] *** May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: nodename: dv-cinder-839793-10-iscsi May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: machine: x86_64 May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: clock source: unix May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: pcre jit disabled May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: detected number of CPU cores: 4 May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: current working directory: / May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: detected binary path: /usr/bin/uwsgi-core May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: your processes number limit is 47680 May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: your memory page size is 4096 bytes May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: detected max file descriptor number: 2048 May 12 17:33:25.563487 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: lock engine: pthread robust mutexes May 12 17:33:25.564367 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: thunder lock: enabled May 12 17:33:25.564367 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 17:33:25.564367 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 17:33:25.608777 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: Python main interpreter initialized at 0x5568edc1c9c0 May 12 17:33:25.608777 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: python threads support enabled May 12 17:33:25.608777 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: your server socket listen backlog is limited to 100 connections May 12 17:33:25.608777 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: your mercy for graceful operations on workers is 90 seconds May 12 17:33:25.609140 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: mapped 403077 bytes (393 KB) for 2 cores May 12 17:33:25.609220 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: *** Operational MODE: preforking *** May 12 17:33:25.609452 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: *** uWSGI is running in multiple interpreter mode *** May 12 17:33:25.609452 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: spawned uWSGI master process (pid: 109291) May 12 17:33:25.609732 dv-cinder-839793-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 17:33:25.610834 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: spawned uWSGI worker 1 (pid: 109292, cores: 1) May 12 17:33:25.610834 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: spawned uWSGI worker 2 (pid: 109293, cores: 1) May 12 17:33:25.610834 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 17:33:26.832391 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:33:26.833044 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:33:27.578777 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:33:27.578777 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: from cryptography.utils import int_from_bytes May 12 17:33:27.579038 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:33:27.579038 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: from cryptography.utils import int_from_bytes May 12 17:33:27.579195 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:33:27.579195 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: from cryptography.utils import int_from_bytes May 12 17:33:27.579310 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:33:27.579310 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: from cryptography.utils import int_from_bytes May 12 17:33:30.193507 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:33:30.194198 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:33:30.194561 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:33:30.194822 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:33:30.194930 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:33:30.195017 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:33:30.195091 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:33:30.195175 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:33:30.195258 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:33:30.195332 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:33:30.195413 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.195486 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.195725 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.195826 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.195940 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.196091 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.196265 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.196373 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.196597 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.196698 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.196915 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.197003 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.197237 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.197330 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.197559 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.197669 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.197903 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.198004 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.198156 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.198259 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.198474 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.198577 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.198826 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-10-iscsi {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.198929 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-10-iscsi {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.199154 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.199263 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.199468 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.199560 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.199780 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.199871 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.200104 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.200202 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.200412 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.200507 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.200740 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.200832 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.201050 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.201148 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.201552 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.201664 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.203346 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.203486 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.203619 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.203722 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.203808 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.203902 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.203902 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204072 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204163 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204248 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204332 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204416 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204553 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204650 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204857 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.204956 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.205184 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.205319 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.205502 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.205599 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.205916 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-10-iscsi {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.206066 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-10-iscsi {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.206229 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.206323 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.206549 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.206642 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.206906 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.207007 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.207327 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.207430 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.207646 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.207745 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.207963 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.208108 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.208286 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.208388 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.208617 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.208764 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.208930 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.209040 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.209259 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.209373 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.209581 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.209684 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.209903 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.209999 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.210223 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.210325 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.210530 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.210633 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.210868 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.210976 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.211181 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.211275 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.211501 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.211591 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.211811 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.211918 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.212119 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.212213 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.212370 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.212472 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.212683 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.212776 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.213008 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.213110 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.213334 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.213422 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.213660 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.213750 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.213914 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.214022 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.214169 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.214258 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.214491 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.214585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.214838 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.214940 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.215153 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.215250 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.215465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.215561 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.215776 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.215870 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.216088 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.216182 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.216397 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.216501 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.216708 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.216795 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.217016 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.217108 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.217327 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.217423 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.217648 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.217743 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.217965 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.218123 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.218315 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.219021 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.219126 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.219284 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.219426 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.219616 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.219832 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.220023 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.220123 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.220281 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.220376 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.220597 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.220717 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.220944 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.221039 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.221271 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.221367 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.221586 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.221690 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.221911 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.222000 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.222240 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.222335 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.222563 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.222699 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.222886 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.222976 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.223201 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.223290 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.223532 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.223631 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.223843 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.223938 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.224098 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.224186 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.224397 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.224491 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.224703 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.224789 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.225010 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.225111 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.225330 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.225423 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.225613 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.225704 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.225923 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.226011 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.226227 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.226322 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.226531 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.226624 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.226863 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.226965 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.227175 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.227269 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.227481 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.227573 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.227792 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.227885 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.228095 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.228245 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.228408 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.228531 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.228712 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.228816 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.229025 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.229130 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.229333 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.229423 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.229651 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.229747 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.229963 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.230062 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.230273 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.230369 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.230582 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.230714 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.230914 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.231012 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.231224 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.231312 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.231536 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.231635 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.231846 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.231942 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.232154 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.232247 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.232463 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.232563 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.232772 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.232867 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.233080 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.233168 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.233398 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.233524 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.233710 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.233826 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.234579 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.234850 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.234990 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.235115 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.235226 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.235334 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.235532 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.235650 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.235848 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.235975 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.236158 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.236286 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.236468 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.236584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.236802 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.236934 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.237074 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.237192 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.237468 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.237660 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.237841 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.237953 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.238062 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.238170 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.238286 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.238402 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.238615 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.238991 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.238991 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.239256 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.239403 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.239540 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.239681 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.239811 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.239945 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.240666 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.240666 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.240842 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.240954 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:33:30.241036 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.241129 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.241215 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.241303 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.241463 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.241566 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.241750 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.241851 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.242089 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.242194 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.242427 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.242549 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.242770 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.242862 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.243088 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.243184 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.243412 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.243500 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.243743 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.243839 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.244061 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.244149 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.244376 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.244462 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.244699 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.244792 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.245012 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.245101 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.245333 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.245444 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.245665 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.245760 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.245986 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.246074 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.246306 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.246399 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.246627 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.246729 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.246966 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.247058 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.247288 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.247389 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.247620 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.247715 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.247945 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.248033 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.248259 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.248347 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.248608 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.248756 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.248956 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.249062 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.249271 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.249360 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.249633 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.249799 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.249956 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.250077 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.250326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.250427 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.250644 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.250777 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.250987 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.251081 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.251320 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.251415 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.251661 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.251758 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.251981 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.252076 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.252306 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.252400 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.252624 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.252723 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.252941 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.253098 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.253257 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.253344 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.253581 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.253669 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.253897 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.253985 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.254235 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.254328 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.254556 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.254657 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.254897 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.254996 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.255216 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.255303 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.255538 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.255630 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.255853 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.255939 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.256169 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.256255 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.256484 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.256579 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.256794 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.256880 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.257101 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.257204 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.257409 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.257503 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.257721 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.257808 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.258029 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.258128 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.258349 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.258436 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.258694 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.258791 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.259014 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.259120 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.259349 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.259438 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.259659 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.259754 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.259973 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.260070 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.260366 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.260472 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.260600 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.260687 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.260909 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.260999 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.261226 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.261320 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.261537 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.261632 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.261847 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.261936 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.262174 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.262261 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.262486 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.262572 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.262820 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.262927 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.263150 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.263239 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.263464 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.263551 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.263774 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.264111 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.264346 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.264432 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.264661 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.264762 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.264974 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.265062 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.265325 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.265433 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.265711 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.265812 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.266044 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.266139 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.266366 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.266454 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.266703 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.266809 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.267050 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.267139 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.267386 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.267475 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.267695 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.267793 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.268026 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.268120 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.268351 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.268444 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.268700 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.268846 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.268979 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.269074 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.269304 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.269398 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.269599 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.269699 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.269910 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.269996 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.270216 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.270303 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.270536 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.270655 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.270872 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.270975 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.271181 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.271273 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.271488 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.271584 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.271795 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.271890 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.272101 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.272198 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.272424 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.272511 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.272737 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.272837 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.273046 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.273143 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.273356 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.273450 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.273665 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.273753 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.274010 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.274110 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.274319 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.274414 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.274684 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.274776 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.275025 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.275169 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.275351 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.275440 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.275677 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.275766 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.275994 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.276084 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.276314 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.276405 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.276628 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.276717 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.276946 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.277037 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.277261 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.277392 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.277578 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.277666 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.277901 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.277996 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.278218 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.278311 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.278541 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.278628 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.278881 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.279033 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.279211 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.279301 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.279525 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.279614 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.279851 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.279940 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.280157 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.280244 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.280480 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.280735 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.281467 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.281635 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.281775 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.281965 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.282057 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.282295 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.282432 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.282613 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.282772 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.282959 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.283104 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.283278 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.283438 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.283597 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.283762 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.283912 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.284087 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.284227 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.286715 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.286846 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.286939 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287023 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287126 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287212 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287310 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287479 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287560 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287655 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287737 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287816 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287895 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.287982 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288070 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288070 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288070 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288070 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288070 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288423 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288508 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288825 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.288978 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.289138 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.289230 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.289453 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.289557 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.289763 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.289891 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.290071 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.290249 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.290384 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.290587 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.290873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.291038 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.291188 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.291330 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.291470 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.291623 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.291768 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.291912 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.292049 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.292209 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.292344 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.292514 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.292661 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.292810 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.292955 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.293121 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.293257 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.293455 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.293598 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.293772 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.293905 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.294090 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.294238 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.294406 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.294540 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.294730 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.294885 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.295108 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.295249 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.295395 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.295540 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.295677 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.295803 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.295938 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.296086 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.296221 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.296372 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.297113 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.297301 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.297467 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.297644 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.297784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.297873 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.298093 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.298182 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.298416 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.298506 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.298762 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.298854 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.299076 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.299165 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.299396 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.299499 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.299704 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.299803 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.300014 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.300102 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.300337 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.300425 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.300652 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.300788 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.300967 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.301058 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.301284 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.301373 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.301611 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.301713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.301909 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.302013 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.302222 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.302310 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.302536 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.302623 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.302869 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.302970 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.303189 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.303284 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.303502 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.303597 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.303808 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.303906 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.304122 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.304223 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.304440 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.304526 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.304760 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.305017 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.305106 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.305353 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.305442 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.305673 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.305769 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.305994 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.306082 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.306307 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.306395 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.306619 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.306751 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.306974 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.307070 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.307298 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.307393 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.307640 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.307874 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.307977 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.308213 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.308302 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.308535 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.308630 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.308840 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.308939 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.309155 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.309243 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.309467 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.309578 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.309772 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.309874 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.310078 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.310172 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.310388 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.310476 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.310711 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.310815 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.311024 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.311121 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.311328 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.311416 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.311636 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.311724 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.311953 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.312095 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.312310 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.312448 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.312652 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.312754 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.312961 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.313086 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.313294 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.313398 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.313610 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.313717 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.313920 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.314008 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.314229 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.314317 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.314537 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.314634 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.314908 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.314998 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.315217 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.315305 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.315537 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.315635 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.315849 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.315937 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.316181 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.316276 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.316499 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.316587 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.316805 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.316899 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.317113 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.317207 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.317426 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.317514 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.317735 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.317828 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.318042 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.318130 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.318355 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.318445 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.318681 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.318772 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.318999 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.319087 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.319313 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.319403 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.319628 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.319727 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.319938 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.320041 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.320250 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.320338 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.320557 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.320645 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.320871 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.321017 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.321178 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.321270 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.321494 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.321580 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.321801 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.321896 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.322106 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.322194 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.322411 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.322506 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.322747 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.322859 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.323063 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.323150 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.323369 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.323455 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.323681 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.323779 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.323987 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.324074 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.324304 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.324390 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.324611 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.324699 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.324917 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.325005 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.325221 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.325314 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.325535 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.325622 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.325845 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.325932 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.326154 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.326241 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.326472 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.326560 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.326808 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.326940 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.327112 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.327245 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.327421 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.327510 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.328280 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.328526 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.328616 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.328880 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.328970 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.329196 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.329284 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.329525 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.329716 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.329848 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.329939 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.330154 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.330242 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.330467 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.330555 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.330796 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.330902 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.331107 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.331203 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.331415 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.331521 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.331724 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.331813 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.332031 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.332119 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.332337 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.332434 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.332642 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.332729 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.332946 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.333034 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.333259 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.333431 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.333584 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.333672 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.333893 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.333982 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.334203 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.334300 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.334512 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.334606 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.334843 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.334934 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.335161 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.335257 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.335475 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.335569 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.335786 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.335875 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.336097 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.336186 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.336409 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.336504 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.336737 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.336833 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.337050 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.337138 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.337360 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.337446 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.337674 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.337761 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.337979 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.338066 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.338297 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.338385 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.338614 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.338757 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.338954 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.339043 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.339261 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.339350 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.339567 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.339670 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.339897 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.339996 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.340210 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.340298 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.340526 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.340622 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.340847 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.340934 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.341161 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.341249 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.341485 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.341594 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.341790 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.341884 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.342103 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.342198 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.342413 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.342514 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.342744 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.342835 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.343065 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.343154 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.343949 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.344050 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.344279 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.344442 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.344593 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.344683 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.344912 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.345001 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.345230 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.345318 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.345543 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.345630 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.345851 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.345947 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.346166 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.346255 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.346480 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.346569 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.346813 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.346904 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.347129 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.347219 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.347445 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.347542 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.347754 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.347850 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.348067 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.348156 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.348375 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.348471 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.348690 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.348778 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.348996 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.349082 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.349311 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.349435 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.349626 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.349752 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.349947 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.350069 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.350277 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.350390 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.350595 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.350721 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.350935 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.351033 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.351256 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.351418 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.351554 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.351639 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.351875 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.351964 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.352187 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.352284 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.352601 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.352696 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.352917 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.353014 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.353241 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.353330 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.353550 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.353638 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.353857 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.353945 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.354173 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.354261 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.354499 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.354586 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.354830 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.354933 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.355139 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.355235 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.355444 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.355566 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.355769 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.355889 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.356077 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.356210 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.356402 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.356530 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.356837 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.356934 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.357146 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.357234 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.357450 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.357537 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.357781 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.357877 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.358095 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.358184 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.358408 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.358496 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.358750 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.358842 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.359146 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.359289 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.359457 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.359547 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.359764 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.359877 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.360083 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.360307 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.360405 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.360630 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.360727 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.360942 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.361030 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.361322 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.361451 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.361641 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.361770 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.361950 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.362052 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.362277 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.362367 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.362604 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.362733 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.362953 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.363060 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.363263 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.363352 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.363585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.363675 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.363901 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.363991 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.364236 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.364331 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.364569 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.364665 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.364890 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.364979 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.365212 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.365301 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.365516 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.365604 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.365829 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.365955 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.366139 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.366235 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.366449 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.366545 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.366795 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.366889 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.367122 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.367218 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.367440 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.367537 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.367756 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.367846 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.368068 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.368156 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.368376 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.368473 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.368691 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.368789 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.369010 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.369099 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.369316 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.369419 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.369643 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.369742 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.369955 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.370042 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.370279 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.370387 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.370595 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.370711 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.370928 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.371028 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.371252 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.371340 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.371563 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.371690 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.371873 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.371964 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.372178 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.372267 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.372485 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.372574 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.372801 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.372888 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.373131 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.373221 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.373451 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.373546 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.373779 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.373867 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.374108 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.374197 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.374424 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.374542 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.374811 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.375013 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.375254 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.375449 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.375545 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.375769 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.376093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.376190 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.376404 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.376632 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.376730 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.377008 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.377174 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.377317 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.377625 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.377780 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.377933 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.378284 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.378372 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.378810 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.378909 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.379367 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.379458 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.379797 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.380026 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.380233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.380581 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.380691 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.380914 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.381166 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.381265 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.381550 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.381741 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.381908 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.382149 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.382497 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.382658 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.382837 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.383180 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.383268 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.383510 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.383824 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.383972 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.384158 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.384377 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.384512 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.384790 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.384941 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.385115 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.385437 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.385582 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.385757 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.385988 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.386136 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.386386 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.386525 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.386726 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.387049 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.387148 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.387364 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.387623 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.387712 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.387989 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.388164 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.388309 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.388706 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.388839 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.389426 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.389514 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.389747 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.390053 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.390945 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.391099 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.391237 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.391369 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.391561 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.391764 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.391892 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.392109 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.392233 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.392449 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.392550 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.392769 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.392869 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.393089 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.393189 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.393433 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.393605 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.393763 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.393921 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.394096 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.394196 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.394430 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.394536 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.394773 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.394873 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.395116 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.395204 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.395418 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.395528 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.395741 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.395831 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.396069 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.396164 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.396395 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.396486 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.396711 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.396806 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.397032 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.397123 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.397353 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.397442 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.397669 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.397758 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.397986 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.398077 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.398297 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.398395 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.398615 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.398740 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.398958 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.399060 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.399274 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.399494 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.399583 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.399830 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.399919 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.400156 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.400247 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.400476 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.400566 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.400796 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.400886 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.401120 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.401220 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.401441 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.401539 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.401759 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.401849 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.402079 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.402187 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.402395 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.402603 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.402736 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.402954 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.403075 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.403302 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.403398 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.403637 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.403727 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.403968 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.404059 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.404295 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.404385 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.404619 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.404708 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.404954 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.405044 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.405269 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.405359 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.405581 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.405679 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.406514 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.406614 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.406854 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.406952 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.407178 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.407283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.407512 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.407603 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.407835 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.407925 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.408157 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.408249 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.408477 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.408567 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.408798 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.408888 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.409120 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.409354 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.409452 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.409715 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.409811 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.410039 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.410145 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.410358 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.410453 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.410722 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.410843 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.411051 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.411169 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.411368 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.411465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.411698 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.411785 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.412009 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.412114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.412323 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.412431 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.412643 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.412849 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.412952 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.413173 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.413262 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.413514 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.413605 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.413850 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.413950 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.414170 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.414263 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.414482 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.414578 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.414824 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.414916 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.415138 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.415228 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.415473 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.415562 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.415783 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.415873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.416092 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.416180 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.416403 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.416493 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.416711 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.416807 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.417022 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.417110 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.417332 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.417421 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.417641 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.417743 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.417951 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.418049 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.418270 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.418358 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.418578 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.418838 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.418932 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.419196 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.419297 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.419517 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.419606 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.419826 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.419915 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.420143 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.420234 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.420476 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.420565 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.420789 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.420885 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.421114 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.421251 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.421449 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.421538 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.421765 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.421869 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.422085 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.422185 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.422406 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.422507 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.422750 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.422863 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.423050 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.423163 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.423367 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.423458 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.423685 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.423775 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.423998 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.424301 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.424394 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.424619 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.424714 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.424947 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.425042 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.425260 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.425350 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.425574 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.425662 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.425887 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.426022 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.426195 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.426283 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.426505 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.426594 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.426838 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.426945 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.427151 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.427242 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.427464 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.427562 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.427779 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.427879 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.428088 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.428183 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.428399 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.428489 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.428707 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.428804 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.429017 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.429106 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.429325 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.429412 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.429633 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.429723 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.429944 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.430077 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.430258 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.430356 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.430574 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.430692 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.430916 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.431006 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.431238 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.431338 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.431556 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.431648 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.431881 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.431968 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.432198 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.432286 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.432519 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.432626 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.432831 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.432926 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.433146 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.433245 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.433465 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.433706 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.433796 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.434054 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.434150 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.434384 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.434475 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.434730 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.434823 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.435044 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.435134 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.435387 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.435477 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.435702 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.435790 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.436018 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.436115 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.436348 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.436438 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.436666 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.436762 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.436985 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.437096 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.437361 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.437461 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.437745 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.437835 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.438064 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.438164 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.438382 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.438478 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.438718 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.438811 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.439040 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.439131 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.439356 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.439446 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.439682 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.439779 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.439999 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.440096 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.440318 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.440407 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.440627 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.440730 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.440936 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.441030 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.441262 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.441359 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.441576 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.441679 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.441885 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.441974 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.442194 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.442283 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.442587 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.442764 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.442853 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.442941 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.443143 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.443233 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.443457 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.443605 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.443766 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.443857 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.444078 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.444167 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.444386 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.444485 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.444694 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.444784 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.445000 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.445126 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.445305 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.445448 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.445611 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.445776 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.445918 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.446106 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.446229 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.446423 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.446521 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.446779 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.446873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.447113 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.447221 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.447432 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.447529 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.447735 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.447824 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.448062 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.448158 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.448395 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.448491 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.448714 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.448803 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.449043 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.449134 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.449360 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.449457 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.449669 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.449759 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.449979 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.450080 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.450292 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.450383 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.450608 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.450717 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.450950 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.451052 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.451264 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.451352 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.451576 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.451675 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.451885 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.451975 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.452200 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.452289 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.452512 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.453126 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.453363 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.453450 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.453656 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.453818 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.453953 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.454138 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.454268 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.454474 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.454623 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.454834 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.454938 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.455149 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.455240 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.455483 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.455573 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.455790 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.455888 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.456100 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.456197 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.456414 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.456503 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.456724 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.456828 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.457036 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.457127 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.457343 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.457440 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.457648 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.457747 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.457954 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.458077 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.458278 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.458374 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.458595 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.458707 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.458942 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.459033 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.459263 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.459352 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.459582 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.459671 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.459910 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.459999 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.460225 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.460322 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.460554 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.460644 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.460881 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.460970 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.461202 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.461291 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.461519 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.461611 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.461857 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.461946 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.462171 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.462282 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.462488 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.462576 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.462823 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.462915 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.463072 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:33:30.463174 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.463450 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.463764 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.464098 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.464431 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.464745 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.465084 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.465412 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.465742 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.466065 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.466385 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.466745 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.467068 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.467389 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.467712 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.468030 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.468882 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.469208 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.469633 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.469978 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.470315 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.470651 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.471013 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.471366 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.471688 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.472043 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.472380 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.472700 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.473021 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.473333 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:33:30.473584 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:33:30.487495 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_db.sqlalchemy.engines [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:30.496766 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_db.sqlalchemy.engines [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:30.552162 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.context [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf7cff43-fd3d-4e09-b3ee-3e94eb237374(cell1) {{(pid=109293) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:33:30.556528 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:33:30.558105 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:33:30.558924 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:33:30.560858 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:33:30.561520 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.context [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf7cff43-fd3d-4e09-b3ee-3e94eb237374(cell1) {{(pid=109292) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:33:30.566555 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_concurrency.lockutils [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:33:30.568191 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_concurrency.lockutils [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:33:30.568996 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_concurrency.lockutils [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:33:30.570987 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_concurrency.lockutils [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:33:30.575188 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_db.sqlalchemy.engines [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:30.576065 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_db.sqlalchemy.engines [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:30.584661 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_db.sqlalchemy.engines [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:30.588303 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_db.sqlalchemy.engines [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:30.750770 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG oslo_db.sqlalchemy.engines [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:30.753887 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_db.sqlalchemy.engines [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:33:31.101305 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: WARNING keystonemiddleware.auth_token [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:33:31.104605 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: WARNING keystonemiddleware.auth_token [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:33:31.108647 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: WARNING keystonemiddleware.auth_token [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:33:31.113439 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: WARNING keystonemiddleware.auth_token [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:33:31.459827 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: WARNING keystonemiddleware.auth_token [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:33:31.460721 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: WARNING keystonemiddleware.auth_token [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:33:31.465834 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: WARNING keystonemiddleware.auth_token [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:33:31.467770 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: WARNING keystonemiddleware.auth_token [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:33:31.472270 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568edc1c9c0 pid: 109292 (default app) May 12 17:33:31.472998 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568edc1c9c0 pid: 109293 (default app) May 12 17:33:31.474342 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:33:31.475553 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-688922cc-5051-46ae-a6bb-11eb138b8f0d None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 May 12 17:33:31.475962 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Thu May 12 17:33:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:34:50.642442 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:34:50.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 May 12 17:34:50.644298 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:34:51.070814 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-7c7d6d01-9ffc-43ea-8b50-f4b5969d82b4 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:34:51.101400 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-7c7d6d01-9ffc-43ea-8b50-f4b5969d82b4 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451312 May 12 17:34:51.102207 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 2/3] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 12 17:34:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:34:53.447969 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:34:53.448962 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-2b43ee21-9a5e-438f-b9c2-a059106d6ba0 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 12 17:34:53.449607 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 2/4] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:34:53.514391 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-baf9e5d1-8c29-448b-876f-c8a319652894 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:34:53.533213 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:34:53.533213 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: warnings.warn(msg) May 12 17:34:53.563037 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-baf9e5d1-8c29-448b-876f-c8a319652894 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107293 May 12 17:34:53.563786 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 3/5] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:34:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:34:53.781228 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-7332f911-529f-455b-b5e1-65a7c5bf02db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:34:53.783674 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:34:53.783674 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: warnings.warn(msg) May 12 17:34:53.833979 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-7332f911-529f-455b-b5e1-65a7c5bf02db admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262473 May 12 17:34:53.834560 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 3/6] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 12 17:34:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:34:56.192436 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-baf9e5d1-8c29-448b-876f-c8a319652894 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:34:56.194070 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-baf9e5d1-8c29-448b-876f-c8a319652894 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 May 12 17:34:56.195004 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 4/7] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:34:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:34:56.306337 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-c357abc2-38a9-4ac9-bd72-c3eae4b3dd26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:34:56.324251 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:34:56.324251 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: warnings.warn(msg) May 12 17:34:56.343357 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-c357abc2-38a9-4ac9-bd72-c3eae4b3dd26 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141697 May 12 17:34:56.343924 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 4/8] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:34:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:34:56.355853 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-ab16a741-bf36-4a5b-bc24-633d42eecbc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:34:56.357346 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:34:56.357346 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: warnings.warn(msg) May 12 17:34:56.391239 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-ab16a741-bf36-4a5b-bc24-633d42eecbc4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038965 May 12 17:34:56.391873 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 5/9] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 12 17:34:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:34:58.692923 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-c357abc2-38a9-4ac9-bd72-c3eae4b3dd26 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:34:58.693940 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-c357abc2-38a9-4ac9-bd72-c3eae4b3dd26 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 12 17:34:58.694338 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:34:58.759842 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-0d4df66b-b079-471f-a159-6b382a821d29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "swap": 0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:34:58.782477 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-0d4df66b-b079-471f-a159-6b382a821d29 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082268 May 12 17:34:58.790084 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 6/11] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:34:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:34:58.795723 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-3780fdee-b85f-4f16-9745-5fc9a18f38a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:34:58.819864 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-3780fdee-b85f-4f16-9745-5fc9a18f38a9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028145 May 12 17:34:58.820489 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 6/12] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 12 17:34:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:35:01.119775 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-0d4df66b-b079-471f-a159-6b382a821d29 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:01.120699 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-0d4df66b-b079-471f-a159-6b382a821d29 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 12 17:35:01.121110 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 7/13] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:01.183535 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-aec09c53-cc56-40c0-a845-2b1152bdd2b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "ram": 2048, "vcpus": 2}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:01.204585 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-aec09c53-cc56-40c0-a845-2b1152bdd2b4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076967 May 12 17:35:01.205148 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 7/14] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:35:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:01.217974 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-0d301d3f-2f9a-48ed-b19c-2fbe481f78d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:01.241389 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-0d301d3f-2f9a-48ed-b19c-2fbe481f78d9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027655 May 12 17:35:01.241930 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 8/15] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 12 17:35:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:35:03.554466 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-aec09c53-cc56-40c0-a845-2b1152bdd2b4 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:03.555551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-aec09c53-cc56-40c0-a845-2b1152bdd2b4 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 12 17:35:03.556240 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 8/16] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:03.618015 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-dba876e1-0e0f-427a-a776-9edf8e30f1cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "vcpus": 4, "disk": 20, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:03.638002 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-dba876e1-0e0f-427a-a776-9edf8e30f1cc admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075242 May 12 17:35:03.638996 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 9/17] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:35:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:03.650820 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-9bfb6851-ef54-44e7-9fdb-ff4c1544491e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:03.675419 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-9bfb6851-ef54-44e7-9fdb-ff4c1544491e admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028289 May 12 17:35:03.676143 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 9/18] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 12 17:35:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:35:05.979551 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-dba876e1-0e0f-427a-a776-9edf8e30f1cc admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:05.980562 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-dba876e1-0e0f-427a-a776-9edf8e30f1cc admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 12 17:35:05.980970 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 10/19] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:06.045986 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-a47629a6-f5a8-4513-bb96-23faf3255851 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:06.070985 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-a47629a6-f5a8-4513-bb96-23faf3255851 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083058 May 12 17:35:06.071538 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 10/20] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 12 17:35:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:35:08.380790 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-dba876e1-0e0f-427a-a776-9edf8e30f1cc admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:08.382068 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-dba876e1-0e0f-427a-a776-9edf8e30f1cc admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001809 May 12 17:35:08.382721 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 11/21] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:08.441844 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-081cf262-4fcc-4226-9125-dc3fb21fde66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:08.461685 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-081cf262-4fcc-4226-9125-dc3fb21fde66 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071192 May 12 17:35:08.462317 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 11/22] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:35:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:08.475405 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-a98c3829-65f3-4186-8d10-6b6ac2dea672 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:08.503347 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-a98c3829-65f3-4186-8d10-6b6ac2dea672 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032575 May 12 17:35:08.503855 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 12/23] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 12 17:35:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:35:10.835235 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-081cf262-4fcc-4226-9125-dc3fb21fde66 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:10.836242 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-081cf262-4fcc-4226-9125-dc3fb21fde66 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 12 17:35:10.836677 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 12/24] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:10.895979 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-9ded7c5e-8ac6-4213-845f-3938268fd628 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "disk": 20, "rxtx_factor": 1.0}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:10.914990 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-9ded7c5e-8ac6-4213-845f-3938268fd628 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071180 May 12 17:35:10.915565 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 13/25] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:35:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:35:10.927226 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-c18425c4-6065-409a-b859-9d4670b6ccaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:10.950456 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-c18425c4-6065-409a-b859-9d4670b6ccaf admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026781 May 12 17:35:10.951755 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 13/26] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 12 17:35:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:35:13.230749 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-9ded7c5e-8ac6-4213-845f-3938268fd628 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:13.231774 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-9ded7c5e-8ac6-4213-845f-3938268fd628 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 May 12 17:35:13.232251 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 14/27] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:13.291715 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-30735d5e-02e3-4cb9-96dc-d08b4b171f77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:13.312037 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-30735d5e-02e3-4cb9-96dc-d08b4b171f77 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073411 May 12 17:35:13.312604 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 14/28] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:35:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:13.324475 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-c2210c40-79c9-4634-a67b-72aa2ff5a0bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:13.349562 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-c2210c40-79c9-4634-a67b-72aa2ff5a0bf admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028767 May 12 17:35:13.350135 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 15/29] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 12 17:35:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:35:15.648121 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-30735d5e-02e3-4cb9-96dc-d08b4b171f77 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:15.649143 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-30735d5e-02e3-4cb9-96dc-d08b4b171f77 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 12 17:35:15.649534 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 15/30] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:15.706399 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-199b06aa-28c4-4eb4-b038-84f366780c59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large"}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:15.730608 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-199b06aa-28c4-4eb4-b038-84f366780c59 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074801 May 12 17:35:15.731189 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 16/31] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:35:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:15.743397 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-70bb235c-21cc-4d08-845b-3b0b423f2444 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:15.766568 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-70bb235c-21cc-4d08-845b-3b0b423f2444 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026763 May 12 17:35:15.767269 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 16/32] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 12 17:35:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:35:18.160665 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-199b06aa-28c4-4eb4-b038-84f366780c59 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:18.164864 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-199b06aa-28c4-4eb4-b038-84f366780c59 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.011952 May 12 17:35:18.176927 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 17/33] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:18.286398 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-646425d1-9a07-4865-812c-13827d23dc2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:18.310815 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-646425d1-9a07-4865-812c-13827d23dc2f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.124298 May 12 17:35:18.311492 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 17/34] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 12 17:35:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:35:18.322991 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-4d1f7fb6-c9b8-4dab-98d3-220bf98a8f9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:18.349047 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-4d1f7fb6-c9b8-4dab-98d3-220bf98a8f9e admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029457 May 12 17:35:18.349937 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 18/35] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 12 17:35:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:35:42.858653 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-646425d1-9a07-4865-812c-13827d23dc2f admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:42.859702 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-646425d1-9a07-4865-812c-13827d23dc2f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 12 17:35:42.860098 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 18/36] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:42.917976 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-431e2d64-30d1-4673-90df-006dc11dafeb admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:42.935300 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-431e2d64-30d1-4673-90df-006dc11dafeb admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068992 May 12 17:35:42.935832 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 19/37] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 12 17:35:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:35:43.946127 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-646425d1-9a07-4865-812c-13827d23dc2f admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:43.947170 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-646425d1-9a07-4865-812c-13827d23dc2f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 12 17:35:43.947579 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 19/38] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:44.148497 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-e8398648-6931-48c5-ac45-787cc6264a7a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:44.153966 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.wsgi [None req-e8398648-6931-48c5-ac45-787cc6264a7a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-e8398648-6931-48c5-ac45-787cc6264a7a admin admin] Request method failure captured: May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Accept: application/json May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Accept-Encoding: gzip, deflate May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Connection: keep-alive May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Content-Length: 0 May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Host: 10.222.0.76 May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Openstack-Api-Version: compute 2.90 May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Openstack-System-Scope: None May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: User-Agent: python-novaclient May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Auth-Token: gAAAAABifUVvcDSMYbucj2QA7HUxuODgl_RtwY-h4IvCjNUdiL5zRl2Xt2RVsIFCVLXr8GpEHyjAPGbGA-awux75aEIO3dShLR4AK45db45mYZsN16KapLh4dkpHuIeo132eQ6bBRrLwbzDFcic1mFdfpqMiOxl7I4USYlPEM---uJNBhYXD5Bc May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Domain-Id: None May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Domain-Name: None May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Identity-Status: Confirmed May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Is-Admin-Project: True May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Domain-Id: default May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Domain-Name: Default May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Name: admin May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Role: admin,member,reader May 12 17:35:44.157262 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Roles: admin,member,reader May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9ec5d27c457b4e7d87f61efe4927f51d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant: admin May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant-Name: admin May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User: admin May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Domain-Id: default May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Domain-Name: Default May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Id: fcec6386453a4aeb83b0960ebf40f96e May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Name: admin May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: method: > May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: exception: Flavor 42 could not be found. May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: action_args: {'id': '42'} May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:35:44.158748 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:44.159713 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:44.161219 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-e8398648-6931-48c5-ac45-787cc6264a7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:35:44.162531 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-e8398648-6931-48c5-ac45-787cc6264a7a admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061384 May 12 17:35:44.162531 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 20/39] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 12 17:35:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:35:44.168343 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-8d83a433-5916-4fa8-8acf-26efed859f94 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:44.189699 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-8d83a433-5916-4fa8-8acf-26efed859f94 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024960 May 12 17:35:44.190236 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 20/40] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 12 17:35:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:35:44.199725 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-1077ea98-72ec-4d71-a278-2ac03b38eaa7 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:44.220703 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-1077ea98-72ec-4d71-a278-2ac03b38eaa7 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024494 May 12 17:35:44.221245 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 21/41] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 12 17:35:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:35:44.230396 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-fe608355-9dd5-4627-b0d8-f7d2da737bda admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:44.236618 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.wsgi [None req-fe608355-9dd5-4627-b0d8-f7d2da737bda admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-fe608355-9dd5-4627-b0d8-f7d2da737bda admin admin] Request method failure captured: May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Accept: application/json May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Accept-Encoding: gzip, deflate May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Connection: keep-alive May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Content-Length: 0 May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Host: 10.222.0.76 May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Openstack-Api-Version: compute 2.90 May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Openstack-System-Scope: None May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: User-Agent: python-novaclient May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Auth-Token: gAAAAABifUVvcDSMYbucj2QA7HUxuODgl_RtwY-h4IvCjNUdiL5zRl2Xt2RVsIFCVLXr8GpEHyjAPGbGA-awux75aEIO3dShLR4AK45db45mYZsN16KapLh4dkpHuIeo132eQ6bBRrLwbzDFcic1mFdfpqMiOxl7I4USYlPEM---uJNBhYXD5Bc May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Domain-Id: None May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Domain-Name: None May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Identity-Status: Confirmed May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Is-Admin-Project: True May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Domain-Id: default May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Domain-Name: Default May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Name: admin May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Role: admin,member,reader May 12 17:35:44.239873 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Roles: admin,member,reader May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9ec5d27c457b4e7d87f61efe4927f51d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant: admin May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant-Name: admin May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User: admin May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Domain-Id: default May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Domain-Name: Default May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Id: fcec6386453a4aeb83b0960ebf40f96e May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Name: admin May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: method: > May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: exception: Flavor 42 could not be found. May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: action_args: {'id': '42'} May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:35:44.241420 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:44.242283 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:44.243366 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-fe608355-9dd5-4627-b0d8-f7d2da737bda admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:35:44.244360 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-fe608355-9dd5-4627-b0d8-f7d2da737bda admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014338 May 12 17:35:44.244360 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 21/42] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 12 17:35:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:35:45.131299 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-1077ea98-72ec-4d71-a278-2ac03b38eaa7 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:45.132308 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-1077ea98-72ec-4d71-a278-2ac03b38eaa7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 12 17:35:45.132710 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 22/43] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:45.322179 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-3ca888d9-b949-4f4f-9d81-732fae563770 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:45.328279 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.wsgi [None req-3ca888d9-b949-4f4f-9d81-732fae563770 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-3ca888d9-b949-4f4f-9d81-732fae563770 admin admin] Request method failure captured: May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Accept: application/json May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Accept-Encoding: gzip, deflate May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Connection: keep-alive May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Content-Length: 0 May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Host: 10.222.0.76 May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Openstack-Api-Version: compute 2.90 May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Openstack-System-Scope: None May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: User-Agent: python-novaclient May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Auth-Token: gAAAAABifUVxZ82leaNnR61dJo0V6E7OMk2PjHtHWhzxWzZYJGNW4PZHsVQ07Atsvgjl-tRSDKljou-yBLszL2gU5RPXs5j4TE-grIODUJWc5JDZdj484UlpbkYcTiwO_1Ctrm_KTHLobEe1oeksN2Aj4S6dH-7cJMfJ2OzzMSyPkV1cKOdj8Ko May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Domain-Id: None May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Domain-Name: None May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Identity-Status: Confirmed May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Is-Admin-Project: True May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Domain-Id: default May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Domain-Name: Default May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Name: admin May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Role: admin,member,reader May 12 17:35:45.329784 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Roles: admin,member,reader May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9ec5d27c457b4e7d87f61efe4927f51d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant: admin May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant-Name: admin May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User: admin May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Domain-Id: default May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Domain-Name: Default May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Id: fcec6386453a4aeb83b0960ebf40f96e May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Name: admin May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: method: > May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: exception: Flavor 84 could not be found. May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: action_args: {'id': '84'} May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:35:45.331345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:45.332392 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:45.333663 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-3ca888d9-b949-4f4f-9d81-732fae563770 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:35:45.335039 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-3ca888d9-b949-4f4f-9d81-732fae563770 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060456 May 12 17:35:45.335039 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 22/44] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 12 17:35:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:35:45.341043 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-2395fd29-aa8e-456d-9f48-025701aaefa1 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:45.354342 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-2395fd29-aa8e-456d-9f48-025701aaefa1 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016962 May 12 17:35:45.354904 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 23/45] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 12 17:35:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:35:45.364049 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-0d8bb1e6-7da7-49c3-9833-879ee093d3af admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:45.378428 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-0d8bb1e6-7da7-49c3-9833-879ee093d3af admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017839 May 12 17:35:45.378989 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 23/46] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 12 17:35:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:35:45.389008 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-dae2d463-6768-449a-8277-830c2ded9242 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:45.394125 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.wsgi [None req-dae2d463-6768-449a-8277-830c2ded9242 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-dae2d463-6768-449a-8277-830c2ded9242 admin admin] Request method failure captured: May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Accept: application/json May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Accept-Encoding: gzip, deflate May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Connection: keep-alive May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Content-Length: 0 May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Host: 10.222.0.76 May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Openstack-Api-Version: compute 2.90 May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Openstack-System-Scope: None May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: User-Agent: python-novaclient May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Auth-Token: gAAAAABifUVxZ82leaNnR61dJo0V6E7OMk2PjHtHWhzxWzZYJGNW4PZHsVQ07Atsvgjl-tRSDKljou-yBLszL2gU5RPXs5j4TE-grIODUJWc5JDZdj484UlpbkYcTiwO_1Ctrm_KTHLobEe1oeksN2Aj4S6dH-7cJMfJ2OzzMSyPkV1cKOdj8Ko May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Domain-Id: None May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Domain-Name: None May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Identity-Status: Confirmed May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Is-Admin-Project: True May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Domain-Id: default May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Domain-Name: Default May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Name: admin May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Role: admin,member,reader May 12 17:35:45.395768 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Roles: admin,member,reader May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9ec5d27c457b4e7d87f61efe4927f51d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant: admin May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant-Name: admin May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User: admin May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Domain-Id: default May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Domain-Name: Default May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Id: fcec6386453a4aeb83b0960ebf40f96e May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Name: admin May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: method: > May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: exception: Flavor 84 could not be found. May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: action_args: {'id': '84'} May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:35:45.397326 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:45.398152 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:45.399280 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-dae2d463-6768-449a-8277-830c2ded9242 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:35:45.400320 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-dae2d463-6768-449a-8277-830c2ded9242 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012605 May 12 17:35:45.400320 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 24/47] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 12 17:35:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:35:46.291971 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-0d8bb1e6-7da7-49c3-9833-879ee093d3af admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:46.292970 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-0d8bb1e6-7da7-49c3-9833-879ee093d3af admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 12 17:35:46.293367 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 24/48] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:46.482444 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-a0bd538e-62db-420d-9b99-c1581f15f899 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:46.488046 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.wsgi [None req-a0bd538e-62db-420d-9b99-c1581f15f899 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-a0bd538e-62db-420d-9b99-c1581f15f899 admin admin] Request method failure captured: May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Accept: application/json May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Accept-Encoding: gzip, deflate May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Connection: keep-alive May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Content-Length: 0 May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Host: 10.222.0.76 May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Openstack-Api-Version: compute 2.90 May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Openstack-System-Scope: None May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: User-Agent: python-novaclient May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Auth-Token: gAAAAABifUVy0qAE7fvj-0hJhXizLpIJsV7Kj5v2S4au8Tsz8bgHFua1mVCBnCCxs5UNBxyh6QtsUvb2tfk0OdD1yzz7zgq4--NKX2a7t0nNS0EeIgeOljAN33aIn9bzwAXs6-swbrwFxCNzAVxcm9oWixWwLCuHxpxY2vUUDCqO55ZMNVpxtYE May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Domain-Id: None May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Domain-Name: None May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Identity-Status: Confirmed May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Is-Admin-Project: True May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Domain-Id: default May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Domain-Name: Default May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Project-Name: admin May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Role: admin,member,reader May 12 17:35:46.489585 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Roles: admin,member,reader May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9ec5d27c457b4e7d87f61efe4927f51d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant: admin May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-Tenant-Name: admin May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User: admin May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Domain-Id: default May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Domain-Name: Default May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Id: fcec6386453a4aeb83b0960ebf40f96e May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: X-User-Name: admin May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: method: > May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: exception: Flavor 451 could not be found. May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: action_args: {'id': '451'} May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:35:46.491114 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:46.492093 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: ERROR nova.api.openstack.wsgi May 12 17:35:46.493465 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-a0bd538e-62db-420d-9b99-c1581f15f899 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:35:46.494734 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-a0bd538e-62db-420d-9b99-c1581f15f899 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060775 May 12 17:35:46.494734 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 25/49] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 12 17:35:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:35:46.501579 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-14971d2c-c3c0-4ad8-8b6e-0b41c7ce820e admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:46.515985 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-14971d2c-c3c0-4ad8-8b6e-0b41c7ce820e admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018915 May 12 17:35:46.516508 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 25/50] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 12 17:35:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:35:46.525630 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:46.539746 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017532 May 12 17:35:46.540261 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 26/51] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 12 17:35:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:35:46.549736 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-60169d9c-fae8-4c5d-a2aa-83085f2a46c4 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:46.555055 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.wsgi [None req-60169d9c-fae8-4c5d-a2aa-83085f2a46c4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-60169d9c-fae8-4c5d-a2aa-83085f2a46c4 admin admin] Request method failure captured: May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Accept: application/json May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Accept-Encoding: gzip, deflate May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Connection: keep-alive May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Content-Length: 0 May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Host: 10.222.0.76 May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Openstack-Api-Version: compute 2.90 May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Openstack-System-Scope: None May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: User-Agent: python-novaclient May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Auth-Token: gAAAAABifUVy0qAE7fvj-0hJhXizLpIJsV7Kj5v2S4au8Tsz8bgHFua1mVCBnCCxs5UNBxyh6QtsUvb2tfk0OdD1yzz7zgq4--NKX2a7t0nNS0EeIgeOljAN33aIn9bzwAXs6-swbrwFxCNzAVxcm9oWixWwLCuHxpxY2vUUDCqO55ZMNVpxtYE May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Domain-Id: None May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Domain-Name: None May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Identity-Status: Confirmed May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Is-Admin-Project: True May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Domain-Id: default May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Domain-Name: Default May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Project-Name: admin May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Role: admin,member,reader May 12 17:35:46.556551 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Roles: admin,member,reader May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9ec5d27c457b4e7d87f61efe4927f51d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9ec5d27c457b4e7d87f61efe4927f51d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant: admin May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant-Id: 9ec5d27c457b4e7d87f61efe4927f51d May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-Tenant-Name: admin May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User: admin May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Domain-Id: default May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Domain-Name: Default May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Id: fcec6386453a4aeb83b0960ebf40f96e May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: X-User-Name: admin May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: method: > May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: exception: Flavor 451 could not be found. May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: action_args: {'id': '451'} May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:35:46.558233 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:46.559231 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: ERROR nova.api.openstack.wsgi May 12 17:35:46.560584 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-60169d9c-fae8-4c5d-a2aa-83085f2a46c4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:35:46.561937 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-60169d9c-fae8-4c5d-a2aa-83085f2a46c4 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011719 May 12 17:35:46.561937 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 26/52] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 12 17:35:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:35:47.453870 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:47.454911 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 12 17:35:47.455312 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 27/53] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:47.646289 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-dcf26b0e-69e5-4339-b35e-2a9ee492f605 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:47.664498 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-dcf26b0e-69e5-4339-b35e-2a9ee492f605 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069709 May 12 17:35:47.665047 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 27/54] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 12 17:35:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:48.567612 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:48.568613 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 12 17:35:48.569008 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 28/55] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:48.757724 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-cdd2ad60-4b07-4ff2-8665-1e5083cfa67d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:48.774931 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-cdd2ad60-4b07-4ff2-8665-1e5083cfa67d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068060 May 12 17:35:48.775477 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 28/56] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 12 17:35:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:49.669775 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:49.670847 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001855 May 12 17:35:49.671242 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 29/57] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:49.862200 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-61dc42a8-2782-4571-902d-18bf9c5ae5ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:49.879649 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-61dc42a8-2782-4571-902d-18bf9c5ae5ec admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068051 May 12 17:35:49.880131 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 29/58] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 12 17:35:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:35:50.798208 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:50.799279 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 12 17:35:50.799694 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 30/59] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:50.993647 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-b287afad-addb-499d-b631-fb5cb8b7993a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:35:51.011900 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-b287afad-addb-499d-b631-fb5cb8b7993a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069296 May 12 17:35:51.013354 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 30/60] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 12 17:35:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:35:51.912559 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:51.913569 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 12 17:35:51.913972 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 31/61] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:35:52.108870 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-3d7dae95-f3d2-419d-828c-10afd3f0d53b admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:35:52.127879 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-3d7dae95-f3d2-419d-828c-10afd3f0d53b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071492 May 12 17:35:52.128345 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 31/62] 10.222.0.76 () {60 vars in 1202 bytes} [Thu May 12 17:35:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:36:54.753443 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:36:54.754447 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-26b6afc7-b28b-4682-84fb-ea3dbac11b8a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 12 17:36:54.754890 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 32/63] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 12 17:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:36:54.813188 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-27f6a731-dab4-4ae3-97bf-0ef20414a81a admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:36:54.832547 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-27f6a731-dab4-4ae3-97bf-0ef20414a81a admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071141 May 12 17:36:54.833083 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 32/64] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 12 17:36:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:36:54.856738 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-a888cded-f8ba-4c09-965e-d78a0a689bd1 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:36:54.864286 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-a888cded-f8ba-4c09-965e-d78a0a689bd1 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012322 May 12 17:36:54.864804 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 33/65] 10.222.0.76 () {60 vars in 1282 bytes} [Thu May 12 17:36:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:36:54.875920 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-312c1367-bef5-46a7-9119-b35163a0de4c admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:36:54.883311 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-312c1367-bef5-46a7-9119-b35163a0de4c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010908 May 12 17:36:54.883846 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 33/66] 10.222.0.76 () {60 vars in 1285 bytes} [Thu May 12 17:36:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:36:54.895381 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:36:54.903906 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012088 May 12 17:36:54.904423 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 34/67] 10.222.0.76 () {60 vars in 1285 bytes} [Thu May 12 17:36:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:36:54.915707 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-2c836cfa-5939-46c8-8df6-030d92b6f9ce admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:36:54.923357 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-2c836cfa-5939-46c8-8df6-030d92b6f9ce admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011124 May 12 17:36:54.923872 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 34/68] 10.222.0.76 () {60 vars in 1282 bytes} [Thu May 12 17:36:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:40:30.743666 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:30.745172 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001828 May 12 17:40:30.746343 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 35/69] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:40:31.062625 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-596d06e6-dbf5-46cc-b62c-2229591d2612 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:31.064400 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:40:31.064400 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: warnings.warn(msg) May 12 17:40:31.065828 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-596d06e6-dbf5-46cc-b62c-2229591d2612 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:31.066696 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-596d06e6-dbf5-46cc-b62c-2229591d2612 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:31.067531 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-596d06e6-dbf5-46cc-b62c-2229591d2612 admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:31.068129 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-596d06e6-dbf5-46cc-b62c-2229591d2612 admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:31.112558 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-596d06e6-dbf5-46cc-b62c-2229591d2612 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.181234 May 12 17:40:31.113413 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 35/70] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 12 17:40:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:40:32.034791 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:32.036961 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 May 12 17:40:32.037652 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 36/71] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:40:32.237224 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-800573d7-f331-461e-bec5-3b3b0b76928a admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:32.238485 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:40:32.238485 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: warnings.warn(msg) May 12 17:40:32.239723 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-800573d7-f331-461e-bec5-3b3b0b76928a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:32.240194 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-800573d7-f331-461e-bec5-3b3b0b76928a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:32.240970 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-800573d7-f331-461e-bec5-3b3b0b76928a admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:32.241398 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-800573d7-f331-461e-bec5-3b3b0b76928a admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:32.261641 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-800573d7-f331-461e-bec5-3b3b0b76928a admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076087 May 12 17:40:32.262124 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 36/72] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 12 17:40:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:40:43.599847 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:43.601904 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002449 May 12 17:40:43.602301 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 37/73] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:40:43.797684 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-2a23dbce-1c23-410f-95cd-25beb0f7c3d4 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:43.798930 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:40:43.798930 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: warnings.warn(msg) May 12 17:40:43.801013 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2a23dbce-1c23-410f-95cd-25beb0f7c3d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:43.801479 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2a23dbce-1c23-410f-95cd-25beb0f7c3d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:43.802260 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2a23dbce-1c23-410f-95cd-25beb0f7c3d4 admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:43.802715 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-2a23dbce-1c23-410f-95cd-25beb0f7c3d4 admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:43.826603 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-2a23dbce-1c23-410f-95cd-25beb0f7c3d4 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080198 May 12 17:40:43.827182 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 37/74] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 12 17:40:43 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:40:44.736087 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: DEBUG nova.api.openstack.wsgi [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] Calling method '>' {{(pid=109292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:44.737094 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: INFO nova.api.openstack.requestlog [None req-b8bafbba-fb42-40d5-b0f3-91e2ce028f32 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 12 17:40:44.737499 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: [pid: 109292|app: 0|req: 38/75] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 12 17:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:40:44.927974 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG nova.api.openstack.wsgi [None req-4c8ebff1-556e-481d-9b21-b3425e9d1c02 admin admin] Calling method '>' {{(pid=109293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:40:44.929316 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:40:44.929316 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: warnings.warn(msg) May 12 17:40:44.930488 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-4c8ebff1-556e-481d-9b21-b3425e9d1c02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:44.930957 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-4c8ebff1-556e-481d-9b21-b3425e9d1c02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:44.931744 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-4c8ebff1-556e-481d-9b21-b3425e9d1c02 admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:40:44.932169 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: DEBUG oslo_concurrency.lockutils [None req-4c8ebff1-556e-481d-9b21-b3425e9d1c02 admin admin] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:40:44.954730 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: INFO nova.api.openstack.requestlog [None req-4c8ebff1-556e-481d-9b21-b3425e9d1c02 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078010 May 12 17:40:44.955223 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: [pid: 109293|app: 0|req: 38/76] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 12 17:40:44 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:41:44.349287 dv-cinder-839793-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 17:41:44.349871 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: Thu May 12 17:41:44 2022 - graceful shutdown triggered... May 12 17:41:44.350321 dv-cinder-839793-10-iscsi devstack@n-api.service[109292]: Gracefully killing worker 1 (pid: 109292)... May 12 17:41:44.350761 dv-cinder-839793-10-iscsi devstack@n-api.service[109293]: Gracefully killing worker 2 (pid: 109293)... May 12 17:41:45.350765 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: worker 1 buried after 1 seconds May 12 17:41:45.350765 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: worker 2 buried after 1 seconds May 12 17:41:45.350765 dv-cinder-839793-10-iscsi devstack@n-api.service[109291]: goodbye to uWSGI. May 12 17:41:45.352265 dv-cinder-839793-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 17:41:45.352831 dv-cinder-839793-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 17:41:45.356257 dv-cinder-839793-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 17:41:45.370828 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 17:41:45 2022] *** May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: nodename: dv-cinder-839793-10-iscsi May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: machine: x86_64 May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: clock source: unix May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: pcre jit disabled May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: detected number of CPU cores: 4 May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: current working directory: / May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: detected binary path: /usr/bin/uwsgi-core May 12 17:41:45.392909 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: your processes number limit is 47680 May 12 17:41:45.393750 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: your memory page size is 4096 bytes May 12 17:41:45.393750 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: detected max file descriptor number: 2048 May 12 17:41:45.393750 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: lock engine: pthread robust mutexes May 12 17:41:45.393750 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: thunder lock: enabled May 12 17:41:45.393750 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 17:41:45.393750 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 17:41:45.443989 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: Python main interpreter initialized at 0x555cc81029c0 May 12 17:41:45.443989 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: python threads support enabled May 12 17:41:45.443989 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: your server socket listen backlog is limited to 100 connections May 12 17:41:45.443989 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: your mercy for graceful operations on workers is 90 seconds May 12 17:41:45.444439 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: mapped 403077 bytes (393 KB) for 2 cores May 12 17:41:45.444439 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: *** Operational MODE: preforking *** May 12 17:41:45.444712 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: *** uWSGI is running in multiple interpreter mode *** May 12 17:41:45.444712 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: spawned uWSGI master process (pid: 123673) May 12 17:41:45.444922 dv-cinder-839793-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 17:41:45.445613 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: spawned uWSGI worker 1 (pid: 123688, cores: 1) May 12 17:41:45.445863 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: spawned uWSGI worker 2 (pid: 123689, cores: 1) May 12 17:41:45.446034 dv-cinder-839793-10-iscsi devstack@n-api.service[123673]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 17:41:46.672359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:41:46.672990 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:41:47.500399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:41:47.500399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: from cryptography.utils import int_from_bytes May 12 17:41:47.500900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:41:47.500900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: from cryptography.utils import int_from_bytes May 12 17:41:47.507787 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:41:47.507787 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: from cryptography.utils import int_from_bytes May 12 17:41:47.508105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:41:47.508105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: from cryptography.utils import int_from_bytes May 12 17:41:49.954889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:41:49.955620 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:41:49.955947 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:41:49.956489 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:41:49.956842 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:41:49.957241 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.957576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.957905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.958232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.958569 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.958917 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.959246 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.959843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.959957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.960158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.960482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.960812 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-10-iscsi {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.961141 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.961558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.961759 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.962122 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.962413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.962824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.963170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.963854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.965286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.965286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.965286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.965559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.965882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.966204 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.966532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.966881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.967219 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.967526 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.967941 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-10-iscsi {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.968268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.968590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.968921 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.969345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.969662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.969984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.970315 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.970651 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.970996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.971324 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.971640 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.971967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.972296 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.972606 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.972931 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.973249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.973578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.973890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.974238 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.974458 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.974990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.975130 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.975320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:41:49.975749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.975848 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:41:49.975947 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.976164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.976273 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:41:49.976426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.976670 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:41:49.976777 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.976934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:41:49.977066 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.977331 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.977437 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.977662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.977764 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.977976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.978083 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.978287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.978393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.978637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.978751 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.979043 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.979149 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.979359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.979461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.979672 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.979778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.980002 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.980108 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.980262 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.980366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.980583 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.980678 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.980913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-10-iscsi {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.981017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.981239 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.981334 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.981550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.981653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.981866 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.981962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.982187 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.982291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.982495 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.982589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.982868 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.982976 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.983179 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.983284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.983503 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.983695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.983812 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.984011 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.984106 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.984323 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.984424 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.984636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.984762 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.985028 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.985140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.985355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.985469 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.985667 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.985769 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.985924 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.986095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.986230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.986455 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.986558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.986841 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.986939 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.987158 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.987261 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.987467 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.987572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-10-iscsi {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.987780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.987921 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.988090 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.988210 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.988392 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.988504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.988699 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.988875 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.989007 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.989188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.989317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.989497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.989627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.989820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.989941 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.990149 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.990253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.990455 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.990550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.990816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.991008 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.991145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.991268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.991464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.991562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.991780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.991890 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.992083 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.992179 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.992389 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.992484 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.992698 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.992807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993121 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993324 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993628 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993879 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.993991 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.994844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.995124 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.995284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.995410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.995534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.995773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.995900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.996118 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.996261 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.996381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.996513 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.996700 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.996827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.997024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.997149 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.997337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.997627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.997753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.997968 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.998098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.998234 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.998447 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.998592 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.998747 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.998886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.999067 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.999200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.999392 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:49.999535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001010 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001179 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001334 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001494 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001983 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.001983 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.002269 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.002269 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.002570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.002836 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.002994 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.003151 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.003307 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.003456 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.003613 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.003764 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.003913 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.004061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.004215 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.004372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.004534 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.004692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.004879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.005104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.005368 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.005535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.005685 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.005844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.006005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.006164 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.006164 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.006455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.006606 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.006781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.006943 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.007092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.007251 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.007416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.007575 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.007733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.007884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.008051 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.008298 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.009077 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.009250 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.009410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.009560 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.009796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.010482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.010636 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.010813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.010813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.011211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.011363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.011521 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.011687 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.011851 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.012010 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.012161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.012318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.012487 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.012637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.012793 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.012942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.013091 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.013248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.013411 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.013561 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.013717 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.013866 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.014023 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.014188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.014188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.014496 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.014654 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.015096 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.015328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.015598 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.015760 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.015910 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.016073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.016230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.016380 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.016536 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.016685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.016852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.017024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.017175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.017325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.017481 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.017637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.017787 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.017945 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.018102 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.018277 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.018500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.018661 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.018937 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.019221 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.019380 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.019538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.019688 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.019853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.020019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.020169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.020318 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.020475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.020634 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.020794 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.020952 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.021632 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.021807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.021915 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.022016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.022113 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.022201 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.022297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.022383 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.022475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.022569 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.022663 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.022850 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.022959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.023055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.023150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.023248 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.023335 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.023420 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.023519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.023612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.023708 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.023708 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.023873 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.023959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:41:50.024065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024233 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024233 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024398 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024398 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024570 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024663 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024756 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024841 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.024933 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025033 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025913 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.025985 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026056 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026135 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026221 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026597 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026787 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.026942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027314 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027569 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.027976 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.028170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.028361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.028546 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.028784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.028953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.029106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.029373 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.029532 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.029690 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.029852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.030017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.030169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.030169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.030472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.030623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.030837 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.031005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.031156 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.031304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.031459 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.031616 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.031848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.032015 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.032173 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.032173 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.032474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.032624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.032782 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.032939 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.033100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.033249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.033397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.033562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.033726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.033876 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.034032 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.034183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.034332 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.034490 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.034653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.034852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.035027 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.035711 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.035970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.036129 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.036297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.036455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.036604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.036759 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.036909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.037068 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.037229 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.037387 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.037537 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.037685 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.037832 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.038014 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.038238 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.038391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.038548 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.038750 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.038983 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.038983 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.039301 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.039564 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.039720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.039870 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.040018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.040182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.040341 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.040498 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.040647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.040802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.041689 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.041986 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.042153 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.042316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.042468 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.042625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.042827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.042827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.043123 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.043272 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.043433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.043585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.043748 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.043898 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.044053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.044210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.044210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.044517 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.044677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.044827 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.044976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.045124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.045280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.045437 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.045619 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.045847 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.046121 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.046278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.046454 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.046636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.046832 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.046994 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.047143 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.047300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.047457 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.047622 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.047782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.047931 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.048088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.048272 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.048503 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.048691 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.048852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.049100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.049271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.049428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.049601 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.049925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.050098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.050264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.050428 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.050585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.050795 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.050901 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.050990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051168 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051348 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051448 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051725 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051834 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.051932 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052014 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052086 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052262 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052346 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052714 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052798 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052889 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.052989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053251 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053343 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053527 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053618 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053893 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.053995 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054258 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054341 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054533 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054719 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.054897 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.055067 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.055224 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.055380 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.055546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.055702 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.055891 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.056145 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.056415 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.056415 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.057349 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.057510 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.057665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.057829 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.057994 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.058162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.058327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.058504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.058665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.058847 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.059002 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.059263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.059426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.059593 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.059749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.060016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.060186 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.060361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.060528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.060685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.060855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.061019 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.061186 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.061345 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.061507 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.061672 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.061846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.062014 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.062268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.062433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.062589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.062784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.062944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.063101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.063266 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.063430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.063586 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.063741 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.063903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.063903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.064220 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.064377 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.064534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.064688 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.064852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.065019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.065183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.065346 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.065504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.065660 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.065830 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.066014 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.066254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.066448 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.066629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.066838 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.067004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.067176 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.067333 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.067496 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.067654 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.067654 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.067956 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.068122 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.068296 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.068461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.068624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.068789 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.068953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.069118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.069118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.069506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.069663 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.069820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.070004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.070250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.070410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.070576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.070769 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.070932 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.071098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.071270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.071433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.071591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.071756 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.071756 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.072071 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.072278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.072517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.072689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.072867 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.073024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.073186 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.073350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.073506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.073677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.073842 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.073842 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.074140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.074302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.074466 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.074636 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.074878 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075037 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075329 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075429 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075517 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075688 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075876 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.075971 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076235 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076365 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076629 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076723 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076836 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.076974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077181 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077181 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077439 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077439 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077669 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077669 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.077935 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078103 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078380 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078510 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078714 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.078979 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.079147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.079345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.079577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.079746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.079904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.080067 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.080252 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.080516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.080704 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.080880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.081038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.081038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.081358 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.081534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.081693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.081848 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.082012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.082168 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.082335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.082512 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.082800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.082966 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.083122 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.083122 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.083435 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.083593 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.083760 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.083925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.084082 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.084245 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.084413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.084578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.084736 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.084899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.085150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.085327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.085327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.085637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.085801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.085972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.086128 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.086294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.086542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.086726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.086902 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.087169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.087335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.087503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.087663 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.087864 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.088039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.088198 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.088366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.088532 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.088699 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.088856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.089031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.089189 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.089344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.089501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.089745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.089907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.090073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.090231 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.090405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.090665 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.090861 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.091030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.091202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.091360 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.091516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.091672 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.091829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.092000 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.092167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.092333 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.092498 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.092674 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.092927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.092927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.093244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.093409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.093572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.093730 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.093886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.094053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.094217 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.094374 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.094538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.094724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.094911 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.095083 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.095325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.095495 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.095660 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.095818 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.095985 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.096144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.096300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.096456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.096642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.096800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.096972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.097170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.097428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.097591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.097748 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.097905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.098073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.098239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.098397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.098560 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.098759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.098923 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.099095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.099264 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.099431 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.099589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.099769 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.100013 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.100177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.100177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.100482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.100657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.100904 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.101114 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.101284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.101441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.101618 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.101784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.101941 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.102112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.102271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.102428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.102585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.102775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.102961 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.103201 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.103364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.104148 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.104414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.104638 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.104840 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.104999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.105165 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.105342 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.105573 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.105743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.105912 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.106079 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.106244 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.106410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.106568 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.106742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.106930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.107096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.107261 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.107444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.107702 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.107871 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.108038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.108202 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.108367 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.108532 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.108697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.108874 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.109032 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.109207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.109372 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.109528 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.109685 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.109918 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.110171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.110335 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.110499 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.110665 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.110896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.111160 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.111331 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.111508 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.111674 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.111838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.111838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.112159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.112317 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.112472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.112637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.112803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.112975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.113133 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.113387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.113548 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.113727 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.113885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.114055 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.114220 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.114384 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.114541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.114718 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.114894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.115065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.115224 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.115387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.115571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.115797 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.115980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.116156 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.116314 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.116478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.116643 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.116799 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.116966 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.117131 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.117295 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.117452 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.117615 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.117886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.118133 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.118311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.118470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.118626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.118821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.118989 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.119796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.120052 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.120306 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.120471 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.120636 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.120794 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.120965 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.121161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.121419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.121582 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.121746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.121914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.122078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.122243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.122399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.122562 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.122753 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.122935 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.123094 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.123252 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.123505 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.123676 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.123841 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.124008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.124173 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.124331 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.124331 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.124636 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.124800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.124971 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.125136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.125310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.125474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.125641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.125824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.126060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.126231 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.126390 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.126546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.126722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.126904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.127070 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.127234 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.127392 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.127562 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.127730 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.127931 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.128181 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.128350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.128509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.128672 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.128836 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.129008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.129165 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.129328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.129328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.129642 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.129808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.129991 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.130149 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.130422 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.130595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.130801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.130973 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.131139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.131304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.131565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.131737 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.131894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.132061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.132218 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.132394 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.132551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.132709 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.132871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.133039 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.133196 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.133352 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.133526 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.133760 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.133934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.134093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.134249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.134412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.134581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.134938 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135480 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135599 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135777 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.135969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136251 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136866 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.136945 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137044 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137126 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137213 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137287 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137357 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137499 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137570 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137875 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.137952 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138037 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138110 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138180 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138257 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138329 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138492 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138747 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138830 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.138911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139086 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139173 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139173 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139344 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139601 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.139980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140059 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140220 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140389 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140462 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140610 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140681 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140760 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.140988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141129 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141211 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141424 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141521 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141609 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141682 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.141933 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142193 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142445 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.142915 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143001 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143094 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143179 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143277 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143370 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143456 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143712 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.143972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.144163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.144281 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.144484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.144603 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.144812 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.144915 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.145134 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.145235 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.145446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.145542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.145759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.145855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.146071 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.146166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.146382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.146482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.146700 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.146810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.147009 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.147104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.147324 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.147421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.147625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.147718 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.147945 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.148048 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.148259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.148362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.148584 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.148793 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.148894 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.149128 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.149230 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.149449 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.149543 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.149767 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.149861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.150085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.150181 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.150430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.150560 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.150773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.150929 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.151111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.151265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.151395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.151576 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.151710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.151901 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.152010 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.152232 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.152327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.152566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.152669 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.152882 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.152977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.153217 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.153312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.153546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.153641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.153863 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.153958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.154268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.154433 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.154524 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.154619 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.154825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.154930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.155132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.155234 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.155442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.155545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.155747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.155849 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.156050 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.156144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.156355 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.156520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.156663 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.156758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.157002 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.157112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.157317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.157414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.157634 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.157735 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.157948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.158043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.158262 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.158365 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.158579 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.158703 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.158920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.159014 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.159226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.159329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.159530 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.159633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.159833 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.159937 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.160176 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.160271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.160479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.160574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.160805 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.160913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.161119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.161333 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.161429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.161656 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.161750 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.161997 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.162101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.162331 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.162424 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.162661 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.162774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.163004 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.163107 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.163316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.163418 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.163632 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.163741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.163946 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.164089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.164257 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.164363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.164571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.164758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.164876 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.164971 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.165184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.165277 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.165494 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.165605 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.165811 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.165906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.166633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.166882 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.167047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.167235 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.167344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.167661 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.167802 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.167974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.168157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.168291 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.168479 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.168606 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.168813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.168940 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.169144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.169253 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.169474 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.169631 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.169774 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.169876 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.170103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.170200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.170417 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.170518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.170752 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.170864 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.171080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.171175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.171395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.171490 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.171709 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.171812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.172021 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.172162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.172338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.172507 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.172654 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.172910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.173005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.173268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.173376 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.173578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.173683 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.173886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.173980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.174199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.174293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.174508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.174630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.174848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.174953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.175163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.175269 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.175471 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.175581 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.175781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.175875 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.176089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.176191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.176397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.176492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.176707 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.176809 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.177016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.177116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.177326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.177421 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.177651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.177756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.177964 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.178064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.178276 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.178371 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.178590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.178752 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.178924 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.179061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.179243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.179340 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.179594 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.179762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.179905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.180076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.180226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.180409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.180542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.180733 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.180871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.181056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.181194 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.181372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.181509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.182360 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.182530 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.182783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.182894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.183127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.183317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.183440 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.183658 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.183762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.183986 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.184081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.184325 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.184427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.184660 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.184763 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.184975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.185106 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.185285 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.185401 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.185607 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.185719 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.185916 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.186012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.186232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.186449 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.186555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.186826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.186924 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.187150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.187259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.187478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.187573 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.187794 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.187900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.188108 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.188203 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.188417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.188511 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.188728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.188828 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.189042 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.189192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.189348 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.189450 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.189659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.189761 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.189971 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.190064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.190279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.190382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.190589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.190710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.190929 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.191035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.191243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.191345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.191551 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.191652 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.191863 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.191972 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.192170 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.192265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.192481 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.192575 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.192793 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.192895 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.193100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.193195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.193409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.193511 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.193722 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.193817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.194028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.194129 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.194339 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.194434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.194645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.194805 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.194974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.195082 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.195291 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.195396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.195595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.195731 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.195903 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.196005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.196208 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.196310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.196520 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.196616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.196824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.196963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.197134 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.197782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.198081 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.198204 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.198424 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.198691 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.198798 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.199004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.199101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.199316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.199411 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.199637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.199732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.199953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.200055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.200281 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.200376 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.200597 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.200691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.200910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.201005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.201218 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.201311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.201525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.201636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.201839 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.202088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.202184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.202428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.202522 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.202757 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.202858 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.203066 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.203167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.203378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.203473 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.203683 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.203842 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.203988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.204159 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.204295 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.204479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.204599 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.204807 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.204948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.205122 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.205224 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.205438 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.205551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.205746 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.205849 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.206056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.206150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.206366 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.206468 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.206682 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.206778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.206993 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.207087 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.207301 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.207395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.207611 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.207705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.207920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.208074 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.208228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.208324 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.208536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.208639 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.208851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.208960 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.209185 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.209279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.209503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.209603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.209821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.209927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.210138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.210231 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.210450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.210544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.210789 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.210888 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.211102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.211208 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.211411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.211506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.211721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.211817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.212033 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.212134 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.212349 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.212443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.212662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.212810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.213565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.213724 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.213894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.214058 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.214209 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.214350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.214512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.214694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.214860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.215012 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.215186 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.215317 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.215511 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.215649 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.215828 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.215987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.216163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.216265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.216482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.216604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.216797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.216908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.217118 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.217220 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.217431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.217533 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.217746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.217842 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.218065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.218171 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.218385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.218482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.218743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.218841 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.219053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.219147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.219366 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.219461 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.219686 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.219782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.219998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.220093 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.220305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.220408 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.220610 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.220741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.220921 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.221088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.221226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.221410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.221513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.221726 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.221828 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.222038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.222132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.222287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:41:50.222405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.222731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.223038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.223342 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.223645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.223947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.224249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.224556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.224862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.225166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.225466 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.225770 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.226070 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.226400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.226763 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.227084 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.227410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.227720 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.228044 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.228353 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.228726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.229052 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.229367 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.229677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.230010 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.230423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.230712 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.231058 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.231563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.232003 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.232326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.232655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.232983 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.233293 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.233625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.233946 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.234270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.234594 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.235070 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.235464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.235766 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.236035 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.236352 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.236663 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.237040 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.237440 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.237874 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.238337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.238730 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.239391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.239494 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.239894 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.240280 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.240637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.241318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.241915 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.242233 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.242562 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:41:50.242820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123689) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:41:50.246502 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_db.sqlalchemy.engines [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.267369 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_db.sqlalchemy.engines [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123689) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.313125 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.context [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf7cff43-fd3d-4e09-b3ee-3e94eb237374(cell1) {{(pid=123688) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:41:50.317556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:41:50.319174 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:41:50.319994 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:41:50.321920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:41:50.333951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_db.sqlalchemy.engines [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.334430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.context [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf7cff43-fd3d-4e09-b3ee-3e94eb237374(cell1) {{(pid=123689) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:41:50.336183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_db.sqlalchemy.engines [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.340380 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:41:50.342499 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:41:50.343605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:41:50.346780 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:41:50.357992 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_db.sqlalchemy.engines [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123689) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.361298 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_db.sqlalchemy.engines [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123689) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.500271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_db.sqlalchemy.engines [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.534913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_db.sqlalchemy.engines [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123689) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:41:50.831329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: WARNING keystonemiddleware.auth_token [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:41:50.839096 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: WARNING keystonemiddleware.auth_token [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:41:50.874006 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: WARNING keystonemiddleware.auth_token [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:41:50.882295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: WARNING keystonemiddleware.auth_token [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:41:51.187612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: WARNING keystonemiddleware.auth_token [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:41:51.193852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: WARNING keystonemiddleware.auth_token [None req-5587a164-3f64-408d-9d2f-1c1227b64aed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:41:51.199300 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555cc81029c0 pid: 123688 (default app) May 12 17:41:51.240035 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: WARNING keystonemiddleware.auth_token [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:41:51.247418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: WARNING keystonemiddleware.auth_token [None req-822e3e5a-0382-4042-b8f9-2355566f23d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:41:51.252544 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555cc81029c0 pid: 123689 (default app) May 12 17:42:32.857135 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7460408f-aa69-48ab-bed0-90f91f08cdfb tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Action: 'create', calling method: .version_select at 0x7f24bdab3280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-418940317", "metadata": {"Type": "work"}}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:34.232340 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9cce84d6-12fc-4218-8fb7-23c8bc8167eb tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Action: 'create', calling method: .version_select at 0x7f24bdab3280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-861007628", "metadata": {"Type": "work"}}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9cce84d6-12fc-4218-8fb7-23c8bc8167eb tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Request method failure captured: May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 121 May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcIipEH5R30uMaqqhOgjknon9m7mnXt36buC-AqiQ3-fLm03MRyJ_BZJkql67A7TPmpuyupZACa68Ln5s0yF2vMYkEYH25uOR7gaDDjwVfUtxmtFIlAg3zsw_DOfgQ7Qnnb1qsNv-_kMCkO09JH8CeUsttEPR3lU69S41EURncPgko May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:42:34.254007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5b9fc19853b84a7da47009ee4a59fb80", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesNegativeTest-596146292-project May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ea691a2a7ff1465aaba5a0e8c19fd5e9 May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesNegativeTest-596146292-project May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-861007628", "metadata": {"Type": "work"}}} May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:42:34.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-861007628', 'metadata': {'Type': 'work'}}}} May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise error May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi '#$%' May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:42:34.256645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:42:34.257991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:42:34.260656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:42:34.260656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.262439 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9cce84d6-12fc-4218-8fb7-23c8bc8167eb tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:42:34.264239 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9cce84d6-12fc-4218-8fb7-23c8bc8167eb tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.197118 May 12 17:42:34.266068 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 12 17:42:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:42:34.285318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1bf82abe-5394-461f-b18b-8ebb1fd25fa4 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Action: 'create', calling method: .version_select at 0x7f24bd9465e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-432488428", "metadata": {"Type": "work"}}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1bf82abe-5394-461f-b18b-8ebb1fd25fa4 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Request method failure captured: May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 119 May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcIipEH5R30uMaqqhOgjknon9m7mnXt36buC-AqiQ3-fLm03MRyJ_BZJkql67A7TPmpuyupZACa68Ln5s0yF2vMYkEYH25uOR7gaDDjwVfUtxmtFIlAg3zsw_DOfgQ7Qnnb1qsNv-_kMCkO09JH8CeUsttEPR3lU69S41EURncPgko May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:42:34.289184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5b9fc19853b84a7da47009ee4a59fb80", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesNegativeTest-596146292-project May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ea691a2a7ff1465aaba5a0e8c19fd5e9 May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesNegativeTest-596146292-project May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-432488428", "metadata": {"Type": "work"}}} May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:42:34.291304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-432488428', 'metadata': {'Type': 'work'}}}} May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise error May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi '0' May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:42:34.293263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:42:34.296623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:42:34.301781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:42:34.301781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.304685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1bf82abe-5394-461f-b18b-8ebb1fd25fa4 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:42:34.305707 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1bf82abe-5394-461f-b18b-8ebb1fd25fa4 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029362 May 12 17:42:34.308565 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 2/2] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 12 17:42:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:42:34.320900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-336bcf81-ec1f-48f3-abfe-dfb49b0af549 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Action: 'create', calling method: .version_select at 0x7f24bdab35e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1978536186", "metadata": {"Type": "work"}}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-336bcf81-ec1f-48f3-abfe-dfb49b0af549 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Request method failure captured: May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 119 May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcIipEH5R30uMaqqhOgjknon9m7mnXt36buC-AqiQ3-fLm03MRyJ_BZJkql67A7TPmpuyupZACa68Ln5s0yF2vMYkEYH25uOR7gaDDjwVfUtxmtFIlAg3zsw_DOfgQ7Qnnb1qsNv-_kMCkO09JH8CeUsttEPR3lU69S41EURncPgko May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:42:34.326563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5b9fc19853b84a7da47009ee4a59fb80", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesNegativeTest-596146292-project May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ea691a2a7ff1465aaba5a0e8c19fd5e9 May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesNegativeTest-596146292-project May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1978536186", "metadata": {"Type": "work"}}} May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:42:34.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1978536186', 'metadata': {'Type': 'work'}}}} May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise error May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi '' May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:42:34.329075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:42:34.331925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:42:34.333073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:42:34.333073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:34.334080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-336bcf81-ec1f-48f3-abfe-dfb49b0af549 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:42:34.337198 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-336bcf81-ec1f-48f3-abfe-dfb49b0af549 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021305 May 12 17:42:34.339888 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 3/3] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 12 17:42:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:42:34.349051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8ff41e18-204d-4394-b75e-49a6c0c4aad7 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Calling method '.version_select at 0x7f24bd966280>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:35.033166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-8ff41e18-204d-4394-b75e-49a6c0c4aad7 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] HTTP exception thrown: Volume tempest-invalid-54826938 could not be found. May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8ff41e18-204d-4394-b75e-49a6c0c4aad7 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Request method failure captured: May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-54826938 HTTP/1.1 May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcIipEH5R30uMaqqhOgjknon9m7mnXt36buC-AqiQ3-fLm03MRyJ_BZJkql67A7TPmpuyupZACa68Ln5s0yF2vMYkEYH25uOR7gaDDjwVfUtxmtFIlAg3zsw_DOfgQ7Qnnb1qsNv-_kMCkO09JH8CeUsttEPR3lU69S41EURncPgko May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:42:35.037523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5b9fc19853b84a7da47009ee4a59fb80", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesNegativeTest-596146292-project May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ea691a2a7ff1465aaba5a0e8c19fd5e9 May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesNegativeTest-596146292-project May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Volume tempest-invalid-54826938 could not be found. May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': 'tempest-invalid-54826938'} May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:42:35.038823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-54826938 could not be found. (HTTP 404) (Request-ID: req-a781b4b4-76fe-45a0-8dbb-7df1ac8224ce) May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.039664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:42:35.041694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-54826938 could not be found. May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:42:35.042785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-54826938 could not be found. May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-54826938 could not be found. May 12 17:42:35.043951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.046936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8ff41e18-204d-4394-b75e-49a6c0c4aad7 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Returning 404 to user: Volume tempest-invalid-54826938 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:42:35.048023 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8ff41e18-204d-4394-b75e-49a6c0c4aad7 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-54826938" status: 404 len: 97 microversion: 2.1 time: 0.702821 May 12 17:42:35.049518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 4/4] 10.222.0.76 () {58 vars in 1211 bytes} [Thu May 12 17:42:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-54826938 => generated 97 bytes in 704 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 12 17:42:35.074277 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f2c26524-312e-461c-a8fd-b66f3ff44296 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020249 May 12 17:42:35.076179 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 5/5] 10.222.0.76 () {58 vars in 1139 bytes} [Thu May 12 17:42:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 17:42:35.099369 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3c43ce0a-8d93-4009-8b0f-1c37e48cb791 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017041 May 12 17:42:35.104234 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 6/6] 10.222.0.76 () {58 vars in 1136 bytes} [Thu May 12 17:42:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 17:42:35.121825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3c6b0873-2931-49de-8664-7cd981c4bfac tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Calling method '.version_select at 0x7f24bd88d1f0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:35.212168 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7460408f-aa69-48ab-bed0-90f91f08cdfb tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.269342 May 12 17:42:35.213317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 1/7] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 12 17:42:31 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3272 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 17:42:35.229019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4e8bbf2a-5fb5-472e-b99d-04e971501c76 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Calling method '.version_select at 0x7f24bd90a280>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:35.265929 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-3c6b0873-2931-49de-8664-7cd981c4bfac tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] HTTP exception thrown: Volume 42d5092f-5612-42b6-907f-9a8446a3eb83 could not be found. May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3c6b0873-2931-49de-8664-7cd981c4bfac tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Request method failure captured: May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/os-volumes/42d5092f-5612-42b6-907f-9a8446a3eb83 HTTP/1.1 May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcIipEH5R30uMaqqhOgjknon9m7mnXt36buC-AqiQ3-fLm03MRyJ_BZJkql67A7TPmpuyupZACa68Ln5s0yF2vMYkEYH25uOR7gaDDjwVfUtxmtFIlAg3zsw_DOfgQ7Qnnb1qsNv-_kMCkO09JH8CeUsttEPR3lU69S41EURncPgko May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:42:35.268308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5b9fc19853b84a7da47009ee4a59fb80", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesNegativeTest-596146292-project May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ea691a2a7ff1465aaba5a0e8c19fd5e9 May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesNegativeTest-596146292-project May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Volume 42d5092f-5612-42b6-907f-9a8446a3eb83 could not be found. May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '42d5092f-5612-42b6-907f-9a8446a3eb83'} May 12 17:42:35.269895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 42d5092f-5612-42b6-907f-9a8446a3eb83 could not be found. (HTTP 404) (Request-ID: req-92f4e24d-aeb2-4fe0-8d3f-4644eb4da000) May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.270884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:42:35.272325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 42d5092f-5612-42b6-907f-9a8446a3eb83 could not be found. May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:42:35.274529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 42d5092f-5612-42b6-907f-9a8446a3eb83 could not be found. May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 42d5092f-5612-42b6-907f-9a8446a3eb83 could not be found. May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3c6b0873-2931-49de-8664-7cd981c4bfac tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Returning 404 to user: Volume 42d5092f-5612-42b6-907f-9a8446a3eb83 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3c6b0873-2931-49de-8664-7cd981c4bfac tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/42d5092f-5612-42b6-907f-9a8446a3eb83" status: 404 len: 109 microversion: 2.1 time: 0.164362 May 12 17:42:35.282480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 7/8] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:42:35 2022] DELETE /compute/v2.1/os-volumes/42d5092f-5612-42b6-907f-9a8446a3eb83 => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:42:35.286483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c2cec47c-2e87-4630-ae5c-60e101b3d7a9 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Calling method '.version_select at 0x7f24bd88d430>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:35.339666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4e8bbf2a-5fb5-472e-b99d-04e971501c76 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a" status: 200 len: 352 microversion: 2.1 time: 0.118567 May 12 17:42:35.340776 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 2/9] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:42:35 2022] GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:42:35.371199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-c2cec47c-2e87-4630-ae5c-60e101b3d7a9 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] HTTP exception thrown: Volume 050eeffc-bfc1-4634-9767-1f6509363dc1 could not be found. May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c2cec47c-2e87-4630-ae5c-60e101b3d7a9 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Request method failure captured: May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/os-volumes/050eeffc-bfc1-4634-9767-1f6509363dc1 HTTP/1.1 May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcIipEH5R30uMaqqhOgjknon9m7mnXt36buC-AqiQ3-fLm03MRyJ_BZJkql67A7TPmpuyupZACa68Ln5s0yF2vMYkEYH25uOR7gaDDjwVfUtxmtFIlAg3zsw_DOfgQ7Qnnb1qsNv-_kMCkO09JH8CeUsttEPR3lU69S41EURncPgko May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:42:35.373417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5b9fc19853b84a7da47009ee4a59fb80", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5b9fc19853b84a7da47009ee4a59fb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 5b9fc19853b84a7da47009ee4a59fb80 May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesNegativeTest-596146292 May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesNegativeTest-596146292-project May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ea691a2a7ff1465aaba5a0e8c19fd5e9 May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesNegativeTest-596146292-project May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Volume 050eeffc-bfc1-4634-9767-1f6509363dc1 could not be found. May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '050eeffc-bfc1-4634-9767-1f6509363dc1'} May 12 17:42:35.375021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 050eeffc-bfc1-4634-9767-1f6509363dc1 could not be found. (HTTP 404) (Request-ID: req-56f2c5b0-6dac-4398-9567-d0bdc5dd70d6) May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.375804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:42:35.377004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 050eeffc-bfc1-4634-9767-1f6509363dc1 could not be found. May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:42:35.378088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 050eeffc-bfc1-4634-9767-1f6509363dc1 could not be found. May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 050eeffc-bfc1-4634-9767-1f6509363dc1 could not be found. May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c2cec47c-2e87-4630-ae5c-60e101b3d7a9 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] Returning 404 to user: Volume 050eeffc-bfc1-4634-9767-1f6509363dc1 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c2cec47c-2e87-4630-ae5c-60e101b3d7a9 tempest-VolumesNegativeTest-596146292 tempest-VolumesNegativeTest-596146292-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/050eeffc-bfc1-4634-9767-1f6509363dc1" status: 404 len: 109 microversion: 2.1 time: 0.094126 May 12 17:42:35.380519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 8/10] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:42:35 2022] GET /compute/v2.1/os-volumes/050eeffc-bfc1-4634-9767-1f6509363dc1 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:42:36.354914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ec7f8c97-6507-48bf-b3e5-cc5abfb4b5b2 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Calling method '.version_select at 0x7f24bd8efa60>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:36.498822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ec7f8c97-6507-48bf-b3e5-cc5abfb4b5b2 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a" status: 200 len: 353 microversion: 2.1 time: 0.149337 May 12 17:42:36.499606 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 9/11] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:42:36 2022] GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:42:36.511599 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-76fe5b37-45ee-470e-a666-770066e6a872 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Calling method '.version_select at 0x7f24bd88d4c0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:36.562519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1957919194", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "networks": [{"uuid": "72fb0d4f-f606-4820-b6fd-84d2e5f2a554"}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:36.598147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-76fe5b37-45ee-470e-a666-770066e6a872 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a" status: 200 len: 353 microversion: 2.1 time: 0.091325 May 12 17:42:36.598947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 10/12] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:42:36 2022] GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:42:36.615476 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-826aa486-25c0-42b3-98ff-4a61d330da0a tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Calling method '.version_select at 0x7f24bd8933a0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:36.726632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] validate_networks() for [('72fb0d4f-f606-4820-b6fd-84d2e5f2a554', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:42:36.747689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-826aa486-25c0-42b3-98ff-4a61d330da0a tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a" status: 202 len: 0 microversion: 2.1 time: 0.135144 May 12 17:42:36.748938 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 11/13] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:42:36 2022] DELETE /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:42:36.756916 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0f75cb24-fd31-41c2-8f98-d13a787b7293 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Calling method '.version_select at 0x7f24bd893a60>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:36.818472 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0f75cb24-fd31-41c2-8f98-d13a787b7293 tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a" status: 200 len: 352 microversion: 2.1 time: 0.064917 May 12 17:42:36.819703 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 12/14] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:42:36 2022] GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:42:37.842812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2ea828fb-f199-4618-a03f-75fcd1c4971c tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Calling method '.version_select at 0x7f24bd88d310>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:37.886395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-2ea828fb-f199-4618-a03f-75fcd1c4971c tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] HTTP exception thrown: Volume 26481476-76e7-475b-9a5b-e0767ad3f25a could not be found. May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2ea828fb-f199-4618-a03f-75fcd1c4971c tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Request method failure captured: May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a HTTP/1.1 May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcHgVtUXbv6CZ-oBySrK-_jQ13JGWa1Ag51sc0Tn6_rS5Peq8SK8ftVQCYH5ELEEOHsO3rctEIH06kqJ73tv1wbtOyuhwLtVqKmHq_T47CecBVTkJfI7DeehPQJO47JWLlQmbmc4PCEt5lJsJmALJ0I9LtbWjFHXyiAlP-yQSmEvEM May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 602bab993c484805a00eca75f117ca3d May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesGetTestJSON-1583370332 May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:42:37.888549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/602bab993c484805a00eca75f117ca3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_602bab993c484805a00eca75f117ca3d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/602bab993c484805a00eca75f117ca3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/602bab993c484805a00eca75f117ca3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesGetTestJSON-1583370332 May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 602bab993c484805a00eca75f117ca3d May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesGetTestJSON-1583370332 May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesGetTestJSON-1583370332-project May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 248fdba5632b4c0f87d66fada5d3c5b3 May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesGetTestJSON-1583370332-project May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Volume 26481476-76e7-475b-9a5b-e0767ad3f25a could not be found. May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '26481476-76e7-475b-9a5b-e0767ad3f25a'} May 12 17:42:37.891140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 26481476-76e7-475b-9a5b-e0767ad3f25a could not be found. (HTTP 404) (Request-ID: req-c2ffee25-2004-4b32-8eae-85f82f1e8702) May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:37.892091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:42:37.893729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 26481476-76e7-475b-9a5b-e0767ad3f25a could not be found. May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:42:37.896655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 26481476-76e7-475b-9a5b-e0767ad3f25a could not be found. May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 26481476-76e7-475b-9a5b-e0767ad3f25a could not be found. May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2ea828fb-f199-4618-a03f-75fcd1c4971c tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] Returning 404 to user: Volume 26481476-76e7-475b-9a5b-e0767ad3f25a could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2ea828fb-f199-4618-a03f-75fcd1c4971c tempest-VolumesGetTestJSON-1583370332 tempest-VolumesGetTestJSON-1583370332-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a" status: 404 len: 109 microversion: 2.1 time: 0.060925 May 12 17:42:37.901781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 13/15] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:42:37 2022] GET /compute/v2.1/os-volumes/26481476-76e7-475b-9a5b-e0767ad3f25a => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:42:38.394875 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:42:38.395520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:42:38.395826 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:42:38.396284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:42:38.396751 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:42:38.442324 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:38.446059 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:38.449156 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:38.449631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:38.570184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Getting quotas for project 502fa29d3bf3465d8616f5e9286733eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:42:38.596356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Getting quotas for user ee6837a9c14d408c8b1da84f7862d144 and project 502fa29d3bf3465d8616f5e9286733eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:42:38.647323 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:42:38.663526 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:42:38.840103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7fc60030-41ac-41f6-bf8a-706b1f62970d tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.682867 May 12 17:42:38.841136 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 3/16] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:42:38.851527 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-70a7f8bb-e4d7-447c-b220-3fff057d1c44 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:38.853711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-70a7f8bb-e4d7-447c-b220-3fff057d1c44 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:39.394758 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-70a7f8bb-e4d7-447c-b220-3fff057d1c44 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:39.428428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-70a7f8bb-e4d7-447c-b220-3fff057d1c44 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1215 microversion: 2.1 time: 0.580737 May 12 17:42:39.429026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 14/17] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:38 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1215 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:42:40.454637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e146de52-e717-4ec5-923f-0c4d39cc35f9 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:40.458112 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e146de52-e717-4ec5-923f-0c4d39cc35f9 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:40.839068 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e146de52-e717-4ec5-923f-0c4d39cc35f9 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:40.877758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e146de52-e717-4ec5-923f-0c4d39cc35f9 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1215 microversion: 2.1 time: 0.434167 May 12 17:42:40.878347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 4/18] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:40 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1215 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:41.895406 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:41.896004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:41.919579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:41.924653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:41.929374 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:41.932879 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:42.656745 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:42.671424 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f6e08a2b-1b5e-4c04-8a81-7b7a3b1076a7 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1267 microversion: 2.1 time: 0.779820 May 12 17:42:42.690763 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 15/19] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:41 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1267 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:43.698966 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:43.701689 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:43.714989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:43.715736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:43.718726 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:43.719373 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:44.225414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:44.251436 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-83766196-7657-45fd-ac2b-6826873fad06 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1267 microversion: 2.1 time: 0.565868 May 12 17:42:44.252031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 5/20] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:43 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1267 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:45.269295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:45.270579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:45.291045 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:45.292363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:45.293188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:45.293631 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:45.830093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:45.838369 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-160d2ea8-7822-4b40-9eee-7ec45173b559 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1275 microversion: 2.1 time: 0.573086 May 12 17:42:45.856712 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 16/21] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:45 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1275 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:46.857159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:46.857788 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:46.871232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:46.875799 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:46.879724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:46.892160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:48.872216 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:48.879842 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7462b878-8c90-4f3b-9045-0f8a7c5e00d3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1273 microversion: 2.1 time: 2.027544 May 12 17:42:48.895099 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 6/22] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:46 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1273 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:49.906764 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:49.907394 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:49.931212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:49.936926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:49.940965 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:49.950575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:50.061165 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-70fdceed-69ff-4e11-9850-b8614f0b0b54 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'create', calling method: .version_select at 0x7f24bd869040>, body: {"keypair": {"name": "tempest-keypair-1075359543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBcH6cZPbF4TFhejDndup8v891IhutoJmzn1XNmA/MNh6W+1oRxx59Dqs3EsyAunOYuIOqKPWYgLV/lfCoIcLvZzgKFYl/73+Nhz/eNG5vU5fpojkH/BpkEvs2jmp/T5Q=="}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:50.167732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-70fdceed-69ff-4e11-9850-b8614f0b0b54 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'key_pairs'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:42:50.184257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-70fdceed-69ff-4e11-9850-b8614f0b0b54 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for user 10626535b6874ef58b63d259f059cd15 and project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'key_pairs'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:42:50.320003 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-70fdceed-69ff-4e11-9850-b8614f0b0b54 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.570091 May 12 17:42:50.321052 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 17/23] 10.222.0.76 () {62 vars in 1199 bytes} [Thu May 12 17:42:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 572 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 17:42:50.722662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:50.734153 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0804840b-3dac-43ad-8de1-65f772ecbddb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.834392 May 12 17:42:50.744396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 7/24] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:49 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:51.753281 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:51.754503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:51.780139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:51.783978 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:51.788831 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:51.789566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:52.300410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:52.316244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f688544b-ab01-430d-bbb2-61d0aac4091c tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.567784 May 12 17:42:52.316885 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 18/25] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:51 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:52.456402 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-58652f47-7e89-4960-a51c-20a76eb11d2f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'create', calling method: .version_select at 0x7f24bc71b3a0>, body: {"keypair": {"name": "tempest-keypair-381943331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHW7PKtdIXiS9Wz6eFgYZ/TZgmgp6xTUdtirLnLiArsvX90A6vOv7AHLerfMHUuSG+FZ6Gnq6731cthubi4JVIZg3gXDnFSK2ul4/vna8mmHBxIsYT2zFOiZZbTedL2fA=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:52.548897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-58652f47-7e89-4960-a51c-20a76eb11d2f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for project bf607837a27e47bf99a32b3b095df070. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:42:52.562290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-58652f47-7e89-4960-a51c-20a76eb11d2f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for user d8866c723166455a9711559eb7f125c4 and project bf607837a27e47bf99a32b3b095df070. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:42:52.675769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-58652f47-7e89-4960-a51c-20a76eb11d2f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.680747 May 12 17:42:52.679705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 8/26] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:42:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:42:53.333632 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:53.334892 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:53.345185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:53.351682 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:53.354528 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:53.356777 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:54.943582 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:54.953301 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-50caa7d0-f302-4cbd-aed4-0c467f0a0e38 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 1.623742 May 12 17:42:54.957460 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 19/27] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:53 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:55.282508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7f140846-fa41-40b2-b0df-4be563333d2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: .version_select at 0x7f24bc71b040>, body: {"keypair": {"name": "tempest-keypair-873705230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/wnlS7sC3Rt+YK0aEOjKBynqTwLRs38v53eypCcU0TpzIkh2ds60efOf1YKHwR5u7/R1pfy3cStnekab1XQDiDgqUYzeExo5yya4ineEyIP4zD1GCoPu9rR6KbjoODgw=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:55.362749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-7f140846-fa41-40b2-b0df-4be563333d2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:42:55.380598 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-7f140846-fa41-40b2-b0df-4be563333d2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:42:55.498549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7f140846-fa41-40b2-b0df-4be563333d2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.572285 May 12 17:42:55.505426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 9/28] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:42:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:42:55.974898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:55.975476 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:55.992147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:55.993351 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:55.998321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:55.998810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:56.258500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-bafe149e-2280-4dbe-8fc5-b09c09f44823 req-4872e0e4-c102-431f-bf36-6a19c22d1377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12066ef2-7740-4910-b039-b7f9274ce2ec", "tag": "30ffa323-c573-4419-9364-4adaabc825fa"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:56.306290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bafe149e-2280-4dbe-8fc5-b09c09f44823 req-4872e0e4-c102-431f-bf36-6a19c22d1377 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:56.310973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bafe149e-2280-4dbe-8fc5-b09c09f44823 req-4872e0e4-c102-431f-bf36-6a19c22d1377 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:56.354308 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-bafe149e-2280-4dbe-8fc5-b09c09f44823 req-4872e0e4-c102-431f-bf36-6a19c22d1377 service nova] Creating event network-changed:30ffa323-c573-4419-9364-4adaabc825fa for instance 12066ef2-7740-4910-b039-b7f9274ce2ec on hv-cinder-83979 May 12 17:42:56.355964 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bafe149e-2280-4dbe-8fc5-b09c09f44823 req-4872e0e4-c102-431f-bf36-6a19c22d1377 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123688) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 17:42:56.360417 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b507f635-df8b-4b4d-884c-4527ef6b154f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:56.368742 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b507f635-df8b-4b4d-884c-4527ef6b154f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:56.370219 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b507f635-df8b-4b4d-884c-4527ef6b154f None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:56.370927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b507f635-df8b-4b4d-884c-4527ef6b154f None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:56.380969 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.compute.rpcapi [None req-b507f635-df8b-4b4d-884c-4527ef6b154f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 17:42:56.382467 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b507f635-df8b-4b4d-884c-4527ef6b154f None None] Releasing lock "compute-rpcapi-router" {{(pid=123688) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 17:42:56.408604 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b507f635-df8b-4b4d-884c-4527ef6b154f None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.399736 May 12 17:42:56.409858 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 10/29] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:42:57.033914 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2008212639", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5ba6af5-8c03-4cd7-80fc-9b0f17cf03c5"}], "security_groups": [{"name": "tempest-securitygroup--2043128707"}], "key_name": "tempest-keypair-1075359543", "user_data": "}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:57.144609 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:57.156149 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f1e06cc8-ae25-4965-9cd8-51568bb98269 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 1.185412 May 12 17:42:57.162604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 20/30] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:55 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:57.365882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] validate_networks() for [('c5ba6af5-8c03-4cd7-80fc-9b0f17cf03c5', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:42:58.184600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:58.185431 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:58.201154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:58.201681 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:58.205360 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:58.205958 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:59.004075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:59.018154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ba121660-e1b3-4a3f-988a-a8fa77c3a33e tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.844145 May 12 17:42:59.022252 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 21/31] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:42:58 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:59.046713 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1639405686", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16b8cd17-5204-4534-ab3e-f50d37e56b44"}], "security_groups": [{"name": "tempest-securitygroup--973746009"}], "key_name": "tempest-keypair-381943331", "user_data": "}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:42:59.174092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:42:59.174572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:42:59.175061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:42:59.175479 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:42:59.175900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:42:59.210953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:59.210953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:59.215569 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:59.217992 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:59.298905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:42:59.306589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for user 10626535b6874ef58b63d259f059cd15 and project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:42:59.341322 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:42:59.344555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:42:59.392295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] validate_networks() for [('16b8cd17-5204-4534-ab3e-f50d37e56b44', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:42:59.518934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9a0923ea-45e1-4d77-a16e-c5eccd2cd489 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.492157 May 12 17:42:59.526509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 11/32] 10.222.0.76 () {62 vars in 1187 bytes} [Thu May 12 17:42:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 12 17:42:59.538495 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7cec60d1-605d-4955-b4f2-e1aca1e0f097 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:59.556446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7cec60d1-605d-4955-b4f2-e1aca1e0f097 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:42:59.712349 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7cec60d1-605d-4955-b4f2-e1aca1e0f097 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:59.722310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7cec60d1-605d-4955-b4f2-e1aca1e0f097 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:59.724607 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7cec60d1-605d-4955-b4f2-e1aca1e0f097 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:42:59.726250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7cec60d1-605d-4955-b4f2-e1aca1e0f097 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1282 microversion: 2.20 time: 0.198266 May 12 17:42:59.738986 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 12/33] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:42:59 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:00.042834 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:00.043459 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:00.073156 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:00.075239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:00.076227 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:00.077978 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:01.034574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:01.045979 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7dce9973-604b-49cf-9382-cb528483435f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 1.010112 May 12 17:43:01.046570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 13/34] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:00 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:01.060986 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-153cf61a-9984-4739-b309-744652cc8cff tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:01.065378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-153cf61a-9984-4739-b309-744652cc8cff tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:01.278016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-153cf61a-9984-4739-b309-744652cc8cff tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:01.299055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-153cf61a-9984-4739-b309-744652cc8cff tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:01.300824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-153cf61a-9984-4739-b309-744652cc8cff tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:01.318451 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-153cf61a-9984-4739-b309-744652cc8cff tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1282 microversion: 2.20 time: 0.265419 May 12 17:43:01.322541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 14/35] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:01 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:01.395484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1722313075", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f0e5ba6-f1dc-4741-a091-633af3cfbec5"}], "security_groups": [{"name": "tempest-securitygroup--1045496249"}], "key_name": "tempest-keypair-873705230", "user_data": "}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:01.776934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] validate_networks() for [('5f0e5ba6-f1dc-4741-a091-633af3cfbec5', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:43:02.344983 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:43:02.345524 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:43:02.346005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:43:02.346601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:43:02.347047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:43:02.392985 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:02.397930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:02.403524 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:02.403995 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:02.515396 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for project bf607837a27e47bf99a32b3b095df070. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:43:02.568877 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for user d8866c723166455a9711559eb7f125c4 and project bf607837a27e47bf99a32b3b095df070. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:43:02.635028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:43:02.659659 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:43:02.934303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8a946163-ae03-4c6a-81d1-ff063a36846d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.894545 May 12 17:43:02.937035 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 22/36] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:42:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 3897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:43:02.956453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:02.959595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:02.979225 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:02.980546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:02.981704 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:03.001739 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:03.093705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:43:03.094191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:43:03.094717 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:43:03.095137 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:43:03.095545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:43:03.107612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:03.108071 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:03.109024 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:03.109636 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:03.210529 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:43:03.217455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:43:03.318140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:43:03.324387 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:43:03.527767 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:03.538511 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d0cabfb3-1fd4-448d-a991-746b3b1b1a87 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.596907 May 12 17:43:03.549067 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 23/37] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:02 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:03.557202 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:03.558094 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:03.564736 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:03.565509 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:03.566518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:03.567119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:03.567230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-10f44e2c-a47d-44f9-98f3-583463efd09e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.177792 May 12 17:43:03.573189 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 15/38] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:43:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:43:03.580453 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-25038da0-3656-467d-a115-6c9f1ea0f7f2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:03.581095 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-25038da0-3656-467d-a115-6c9f1ea0f7f2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:03.765409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-25038da0-3656-467d-a115-6c9f1ea0f7f2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:03.772200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:03.780106 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-25038da0-3656-467d-a115-6c9f1ea0f7f2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1237 microversion: 2.1 time: 0.205513 May 12 17:43:03.781045 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 16/39] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:03 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1237 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:03.792991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:03.796761 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:03.799238 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9e209abb-34bb-48ac-80f6-ab85fd251184 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:03.799951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9e209abb-34bb-48ac-80f6-ab85fd251184 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:03.800890 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-dda3d29d-eed5-4efa-9e64-f2d6ea4e361b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1334 microversion: 2.20 time: 0.250495 May 12 17:43:03.801478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 24/40] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:03 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1334 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:03.876047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9e209abb-34bb-48ac-80f6-ab85fd251184 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:03.884443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9e209abb-34bb-48ac-80f6-ab85fd251184 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1241 microversion: 2.1 time: 0.092052 May 12 17:43:03.885902 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 17/41] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:03 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:04.564644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:04.565535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:04.572928 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.573381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.574261 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.574780 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.725781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:04.735519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-bdf71a3a-0768-47a4-9d87-d386324b7ff6 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.175290 May 12 17:43:04.736651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 25/42] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:04 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:04.799287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:04.800012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:04.806760 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.807514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.808426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.808988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.819866 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:04.821078 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:04.827650 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.828226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.829124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.829797 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.877722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:04.886070 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a92bf4c3-1f2f-454c-b6cb-125f139011af tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1241 microversion: 2.1 time: 0.091113 May 12 17:43:04.886777 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 18/43] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:04 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:04.904059 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:04.904665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:04.910441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:04.911312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.911767 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.912541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.912982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.924810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:04.926389 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:04.927706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-aed975ef-6532-47de-a7a9-86d92ce07999 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1334 microversion: 2.20 time: 0.111680 May 12 17:43:04.928412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 26/44] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:04 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:04.980377 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:04.991410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-be435bdd-c8d1-4921-af07-9fcbba94ca2d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1245 microversion: 2.1 time: 0.090980 May 12 17:43:04.992441 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 19/45] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:04 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:05.753463 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:05.754209 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:05.761091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:05.761639 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:05.762530 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:05.763065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:05.903630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:05.904463 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:05.910455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:05.911015 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:05.911825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:05.912274 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:05.951884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:05.959561 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b59ca56f-678c-401b-a971-2ccb84bc1996 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.210061 May 12 17:43:05.960313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 27/46] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:05 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:05.970117 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:05.970759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:05.978149 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:05.979099 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:05.980045 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:05.980625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:05.988609 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:05.998301 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f2fae8ad-dbae-4cb0-a205-3021d1d6e8e9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1241 microversion: 2.1 time: 0.098541 May 12 17:43:05.999145 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 20/47] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:05 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:06.015120 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:06.015788 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:06.021795 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:06.022252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:06.023060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:06.023655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:06.061690 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:06.069590 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:06.071199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:06.072317 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-473a4ce4-681e-496b-ba2b-4de938c22a78 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1334 microversion: 2.20 time: 0.110879 May 12 17:43:06.073098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 28/48] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:05 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1334 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:06.093097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:06.100279 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-237b9b0a-2dfc-4ebd-a009-47aae60fb7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1245 microversion: 2.1 time: 0.088874 May 12 17:43:06.100847 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 21/49] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:06 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:06.978571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:06.979217 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:06.987017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:06.987450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:06.988320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:06.988773 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:07.016459 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:07.017111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:07.027208 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:07.034848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:07.035989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:07.036588 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:07.139918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:07.149973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3ee0575a-59f0-4886-8984-440675cabedd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1233 microversion: 2.1 time: 0.137325 May 12 17:43:07.151072 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 22/50] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:07 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1233 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:07.156060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:07.156805 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:07.163520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:07.164289 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:07.165999 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:07.166443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:07.230353 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:07.242596 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e9124b5a-9b7f-4c97-8e59-34ee9e75107f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.269616 May 12 17:43:07.244036 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 29/51] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:06 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:07.247001 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:07.254909 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:07.255445 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:07.256349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:07.256465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:07.257508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f71db397-8b72-49ed-b6a2-e0c9cfb317ed tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1352 microversion: 2.20 time: 0.105370 May 12 17:43:07.258064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 23/52] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:07 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:07.264139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:07.264600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:07.265386 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:07.265861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:07.331904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:07.340236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e3b3ceb5-78e9-4bf7-ac4e-c59963a4197d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1237 microversion: 2.1 time: 0.094548 May 12 17:43:07.340810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 30/53] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:07 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:08.169547 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:08.170728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:08.179587 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.181028 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.182390 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.183856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.261259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:08.262375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:08.275492 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.285230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:08.291461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.292313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.292762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.295571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0dde8a03-c76c-4811-a7a0-4e95c4e4ea75 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1289 microversion: 2.1 time: 0.131902 May 12 17:43:08.311908 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 24/54] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:08 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:08.311908 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:08.311908 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:08.330801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.332957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.333850 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.337488 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.485941 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:08.507670 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:08.514250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:08.515509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-26fd0543-005a-4528-959d-77146a30bfad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1340 microversion: 2.20 time: 0.212241 May 12 17:43:08.516349 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 25/55] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:08 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:08.537860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:08.541269 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:08.560000 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.560709 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.562239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:08.563621 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:08.833190 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:08.844247 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-403454ab-11c8-4498-9b21-849e90ad6341 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.586227 May 12 17:43:08.858743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 31/56] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:08 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:08.904740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:08.943684 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ad26c3a5-c476-4bd8-99b1-932d548b8ddf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1293 microversion: 2.1 time: 0.417027 May 12 17:43:08.950407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 26/57] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:08 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1293 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:09.322303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:09.325397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:09.345254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.347903 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:09.350473 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.358337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:09.520697 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:09.533399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9f28b22c-232f-4775-8eaf-ef374adad699 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1295 microversion: 2.1 time: 0.216839 May 12 17:43:09.535527 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 32/58] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:09 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:09.541817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:09.542803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:09.557402 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.559919 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:09.563656 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.564208 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:09.699379 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:09.710527 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:09.718483 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:09.731321 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9c5afccd-a665-4ac4-805f-b79cfbe96ef4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1340 microversion: 2.20 time: 0.186792 May 12 17:43:09.731321 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 27/59] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:09 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1340 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:43:09.863368 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:09.864248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:09.870934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.871747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:09.872757 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.873399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:09.970019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:09.970423 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:09.978069 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.978523 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:09.979482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:09.979922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:10.085253 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:10.101893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7cb63037-11b2-456f-a20d-a63309579610 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.241969 May 12 17:43:10.114381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 33/60] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:09 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:10.146498 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:10.156411 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a47948f7-07a8-4685-ac4b-371aea15f0b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1299 microversion: 2.1 time: 0.190060 May 12 17:43:10.157011 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 28/61] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:09 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:10.554587 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:10.556600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:10.574043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:10.574643 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:10.575513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:10.576237 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:10.737634 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:10.738235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:10.745208 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:10.746122 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:10.747359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:10.747977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:11.026858 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:11.036152 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-82c6ba0a-4ed3-4fea-8db3-472c34529994 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1362 microversion: 2.1 time: 0.487247 May 12 17:43:11.037164 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 34/62] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:10 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:11.194138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:11.213843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:11.218735 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:11.220693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-54997705-9c87-4d78-992b-c132a02683b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.487237 May 12 17:43:11.222211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 29/63] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:10 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:43:11.229069 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:11.229918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:11.243073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:11.243572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:11.244446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:11.245237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:11.380738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-d95bd042-ddf0-40f0-933f-6540bb608202 req-0c286bee-e1b5-4cda-b87f-850063f347a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066ef2-7740-4910-b039-b7f9274ce2ec", "name": "network-vif-plugged", "status": "completed", "tag": "30ffa323-c573-4419-9364-4adaabc825fa"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:11.407635 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d95bd042-ddf0-40f0-933f-6540bb608202 req-0c286bee-e1b5-4cda-b87f-850063f347a7 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:11.408167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d95bd042-ddf0-40f0-933f-6540bb608202 req-0c286bee-e1b5-4cda-b87f-850063f347a7 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:11.475150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-d95bd042-ddf0-40f0-933f-6540bb608202 req-0c286bee-e1b5-4cda-b87f-850063f347a7 service nova] Creating event network-vif-plugged:30ffa323-c573-4419-9364-4adaabc825fa for instance 12066ef2-7740-4910-b039-b7f9274ce2ec on hv-cinder-83979 May 12 17:43:11.479168 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d95bd042-ddf0-40f0-933f-6540bb608202 req-0c286bee-e1b5-4cda-b87f-850063f347a7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123689) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 17:43:11.480464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8eab16ff-f93c-4098-afca-04fadada9051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:11.480984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8eab16ff-f93c-4098-afca-04fadada9051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:11.482624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8eab16ff-f93c-4098-afca-04fadada9051 None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:11.484668 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8eab16ff-f93c-4098-afca-04fadada9051 None None] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:11.506615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.compute.rpcapi [None req-8eab16ff-f93c-4098-afca-04fadada9051 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 17:43:11.507610 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8eab16ff-f93c-4098-afca-04fadada9051 None None] Releasing lock "compute-rpcapi-router" {{(pid=123689) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 17:43:11.547234 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8eab16ff-f93c-4098-afca-04fadada9051 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508480 May 12 17:43:11.547826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 35/64] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:11.554706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:11.559018 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:11.577948 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:11.583540 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:11.584664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:11.585182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:12.165578 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:12.176372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-99428e93-48a2-4ace-913e-5757f3bd9894 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.626723 May 12 17:43:12.179459 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 36/65] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:11 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:12.189229 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-fb405186-c459-48ca-8fc7-8750d435cee3 req-7f963c0c-13bc-48de-96d5-35952717a069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92a89c3-a796-4a8b-9491-3f944bca5a9b", "tag": "dae83d1a-12ad-4d98-a4d1-13233ca983ae"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:12.196118 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:12.204197 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-fb405186-c459-48ca-8fc7-8750d435cee3 req-7f963c0c-13bc-48de-96d5-35952717a069 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:12.204413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-89358494-67a2-4fcf-9b19-3e275d01d1b3 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.980662 May 12 17:43:12.204943 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 30/66] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:11 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:12.217034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:12.221879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:12.225054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-fb405186-c459-48ca-8fc7-8750d435cee3 req-7f963c0c-13bc-48de-96d5-35952717a069 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:12.229734 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:12.233182 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:12.237387 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:12.240860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:12.253265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-fb405186-c459-48ca-8fc7-8750d435cee3 req-7f963c0c-13bc-48de-96d5-35952717a069 service nova] Creating event network-changed:dae83d1a-12ad-4d98-a4d1-13233ca983ae for instance a92a89c3-a796-4a8b-9491-3f944bca5a9b on hv-cinder-83979 May 12 17:43:12.258882 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-fb405186-c459-48ca-8fc7-8750d435cee3 req-7f963c0c-13bc-48de-96d5-35952717a069 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077599 May 12 17:43:12.259807 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 37/67] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:12.266477 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:12.267542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:12.275685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:12.276135 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:12.277126 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:12.277748 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:12.612029 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:12.626658 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:12.628604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:12.631051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2583c46a-5a6c-456b-a2ff-a43cbf8009a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.369740 May 12 17:43:12.632413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 38/68] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:12 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:12.951344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:12.958804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1f17d988-6cab-4de6-b40b-0acde788c26d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1362 microversion: 2.1 time: 0.748551 May 12 17:43:12.959399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 31/69] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:12 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1362 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:13.193057 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:13.194002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:13.201669 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.202390 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:13.203411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.204123 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:13.221679 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:13.223015 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:13.232758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.236561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:13.237660 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.240916 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:13.427792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:13.437718 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-dde91403-0dc0-4a58-8b85-77cdaaaf2af9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.247780 May 12 17:43:13.440322 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 39/70] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:13 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:13.654447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:13.657079 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:13.669511 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.670875 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:13.671888 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.672718 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:13.764986 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:13.780428 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-63076cb2-dfcb-4a7c-83fa-7c8a78f192fd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.562839 May 12 17:43:13.781391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 32/71] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:13 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:13.947754 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:13.960555 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:13.962523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:13.965566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e1160ea0-2d84-4a09-be42-a10245674ef9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.319784 May 12 17:43:13.979366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:13.980240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:13.985906 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 40/72] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:13 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:13.989503 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.990472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:13.991793 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:13.992431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:14.354273 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-895ffc6a-da28-4713-97c8-87fa4e5c083a req-0c58e5cf-2fb6-43e3-9a18-95791f296d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b3f033-5f36-4355-8221-ab55bcba8722", "tag": "20f0b51d-9edf-437d-a233-3e26daa2ef7c"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:14.368972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-895ffc6a-da28-4713-97c8-87fa4e5c083a req-0c58e5cf-2fb6-43e3-9a18-95791f296d55 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:14.370976 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-895ffc6a-da28-4713-97c8-87fa4e5c083a req-0c58e5cf-2fb6-43e3-9a18-95791f296d55 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:14.391400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-895ffc6a-da28-4713-97c8-87fa4e5c083a req-0c58e5cf-2fb6-43e3-9a18-95791f296d55 service nova] Creating event network-changed:20f0b51d-9edf-437d-a233-3e26daa2ef7c for instance 12b3f033-5f36-4355-8221-ab55bcba8722 on hv-cinder-83979 May 12 17:43:14.397390 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-895ffc6a-da28-4713-97c8-87fa4e5c083a req-0c58e5cf-2fb6-43e3-9a18-95791f296d55 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239835 May 12 17:43:14.398742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 41/73] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:14.461816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:14.463682 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:14.481735 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:14.490629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:14.491135 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:14.493340 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b8f46f18-3d34-45f5-ad40-456b6c1bb6ba tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1362 microversion: 2.1 time: 0.517465 May 12 17:43:14.500163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:14.500648 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:14.505699 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 33/74] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:13 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:14.797666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:14.798267 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:14.808730 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:14.809393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:14.809948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:14.810580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:14.965132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:14.972605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e3705320-ef60-4272-b43a-56235b0ce28a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.519332 May 12 17:43:14.982289 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 42/75] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:14 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:14.983589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:14.984359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:14.990598 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:14.991137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:14.991916 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:14.992365 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:15.210620 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:15.227949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:15.229678 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:15.230856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-274e147c-ebf0-4277-a547-7ae0784e5b43 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.251065 May 12 17:43:15.231432 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 43/76] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:14 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:15.295346 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:15.302632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8051684a-10d8-4a8f-b7a9-2c5682b9e692 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.508865 May 12 17:43:15.310952 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 34/77] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:14 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:15.511949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:15.512929 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:15.519841 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:15.520752 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:15.521753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:15.522400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:15.777280 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:15.784624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-11dd618a-60ed-430c-9355-5ff8cea3f805 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1362 microversion: 2.1 time: 0.277294 May 12 17:43:15.793616 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 44/78] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:15 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:15.991515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:15.992206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:16.002647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.002647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.002821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.003184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.214611 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:16.222864 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3b140dd3-8d0b-48f2-860f-05bac7b174ff tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.236882 May 12 17:43:16.223684 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 35/79] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:15 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:16.249517 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:16.250369 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:16.257402 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.257893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.259508 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.260100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.327019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:16.328104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:16.339690 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.342620 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.343668 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.349489 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.563069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:16.575516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:16.579776 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:16.582101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-329a3d6e-4ac1-4c5f-9f26-b220421e6811 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.336747 May 12 17:43:16.585394 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 45/80] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:16 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:16.598321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-02258dae-3482-4f9c-9759-22f76df6bceb req-439bcc58-1f3b-4c53-88f9-bc48c27c6b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70784c5b-3ded-4e8a-ab43-6e738bf4eea5", "tag": "b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:16.622815 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-02258dae-3482-4f9c-9759-22f76df6bceb req-439bcc58-1f3b-4c53-88f9-bc48c27c6b38 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.623875 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-02258dae-3482-4f9c-9759-22f76df6bceb req-439bcc58-1f3b-4c53-88f9-bc48c27c6b38 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.638555 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-02258dae-3482-4f9c-9759-22f76df6bceb req-439bcc58-1f3b-4c53-88f9-bc48c27c6b38 service nova] Creating event network-changed:b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1 for instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 on hv-cinder-83979 May 12 17:43:16.647384 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-02258dae-3482-4f9c-9759-22f76df6bceb req-439bcc58-1f3b-4c53-88f9-bc48c27c6b38 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060499 May 12 17:43:16.649976 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 46/81] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:16.803644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:16.808623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:16.809885 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:16.816503 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-bb366413-cf3a-4eea-8d16-98803cc8bb83 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1315 microversion: 2.1 time: 0.493037 May 12 17:43:16.818127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 36/82] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:16 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:16.825574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-6d90ca23-44c1-469a-b8ec-c2b30718d887 req-1bf628cb-93d2-40ed-ad19-0855bb99a50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92a89c3-a796-4a8b-9491-3f944bca5a9b", "name": "network-vif-plugged", "status": "completed", "tag": "dae83d1a-12ad-4d98-a4d1-13233ca983ae"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:16.827545 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.828024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.830653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.831135 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.839000 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-6d90ca23-44c1-469a-b8ec-c2b30718d887 req-1bf628cb-93d2-40ed-ad19-0855bb99a50b service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:16.840116 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-6d90ca23-44c1-469a-b8ec-c2b30718d887 req-1bf628cb-93d2-40ed-ad19-0855bb99a50b service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:16.856415 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-6d90ca23-44c1-469a-b8ec-c2b30718d887 req-1bf628cb-93d2-40ed-ad19-0855bb99a50b service nova] Creating event network-vif-plugged:dae83d1a-12ad-4d98-a4d1-13233ca983ae for instance a92a89c3-a796-4a8b-9491-3f944bca5a9b on hv-cinder-83979 May 12 17:43:16.864323 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-6d90ca23-44c1-469a-b8ec-c2b30718d887 req-1bf628cb-93d2-40ed-ad19-0855bb99a50b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044382 May 12 17:43:16.865287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 37/83] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:17.086821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:17.096143 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-65372340-9361-4503-992a-03604b417b03 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1362 microversion: 2.1 time: 0.293458 May 12 17:43:17.096993 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 47/84] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:16 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:17.247298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:17.248013 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:17.255235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:17.255696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:17.256682 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:17.257178 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:17.541078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:17.550194 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0074725c-10ad-4fe3-8fc0-eb5bcabb899e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.310831 May 12 17:43:17.551298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 38/85] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:17 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:17.604208 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:17.605463 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:17.611315 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:17.611984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:17.612753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:17.613426 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:17.786434 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:17.795619 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:17.797041 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:17.798149 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8e3d9e5c-0b0f-422f-b0ca-7d6c527d2f83 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.198343 May 12 17:43:17.799063 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 48/86] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:17 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:43:17.834131 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:17.834766 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:17.850157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:17.859072 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:17.860679 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:17.861339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:18.112924 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:18.114878 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:18.115556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:18.123464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:18.124233 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:18.124511 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a7abb9d3-327d-4577-9360-01069c989599 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1501 microversion: 2.1 time: 0.294103 May 12 17:43:18.125098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 39/87] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:17 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1501 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:18.125655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:18.126420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:18.299699 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:18.308690 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f73628fd-c1b8-4fa3-ba89-f61fd883d864 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1362 microversion: 2.1 time: 0.197839 May 12 17:43:18.309224 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 49/88] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:18 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:18.573191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:18.574587 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:18.594360 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:18.594856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:18.600637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:18.601418 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:18.789912 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:18.800022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1177df59-d34f-4cbe-9493-df1315e1cf30 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.234960 May 12 17:43:18.800611 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 40/89] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:18 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:18.817953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:18.818465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:18.831744 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:18.832207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:18.833001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:18.833444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:19.034443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:19.043769 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:19.045284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:19.059009 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e72f6d74-f30d-4320-a687-b3b5e60a1f9e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.245591 May 12 17:43:19.070239 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 50/90] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:18 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:19.328322 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:19.329244 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:19.348756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:19.349484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:19.355637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:19.356558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:19.697648 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:19.706444 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-cf5967ea-131c-4e85-ba77-659225c7ba30 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1362 microversion: 2.1 time: 0.384074 May 12 17:43:19.707061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 41/91] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:19 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:19.718603 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-53bfdf6e-5e9d-4549-9af6-e9799a6524b0 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4af4aa5a-c688-493e-9011-32ee7fda1b3a"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:19.719903 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-53bfdf6e-5e9d-4549-9af6-e9799a6524b0 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:19.729518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-53bfdf6e-5e9d-4549-9af6-e9799a6524b0 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:19.731137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-53bfdf6e-5e9d-4549-9af6-e9799a6524b0 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:19.732185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-53bfdf6e-5e9d-4549-9af6-e9799a6524b0 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:19.732820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-53bfdf6e-5e9d-4549-9af6-e9799a6524b0 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:19.817499 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:19.818560 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:19.829909 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:19.830457 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:19.831518 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:19.832146 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:19.995330 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:20.004497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7c4fdb33-b0fb-4790-ae18-1e87ffa645d3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.191309 May 12 17:43:20.018412 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 42/92] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:19 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:20.080935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:20.081914 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:20.090840 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:20.092232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:20.093578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:20.095171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:20.484755 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:20.492879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:20.498150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:20.501427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-52ecb656-45c5-4e5f-ba35-3f95f97a05ba tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.427818 May 12 17:43:20.501891 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 43/93] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:20 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:43:20.634108 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-53bfdf6e-5e9d-4549-9af6-e9799a6524b0 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "POST /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918750 May 12 17:43:20.651795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 51/94] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:43:19 2022] POST /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:20.729504 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:20.733113 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:20.756306 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:20.757116 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:20.761932 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:20.765125 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.011500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-c0d926cd-2755-4de6-a3d0-b84cf4c1bedb req-d46ca197-237b-4e16-a8f2-b0df2c10824a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b3f033-5f36-4355-8221-ab55bcba8722", "name": "network-vif-plugged", "status": "completed", "tag": "20f0b51d-9edf-437d-a233-3e26daa2ef7c"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:21.028043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-c0d926cd-2755-4de6-a3d0-b84cf4c1bedb req-d46ca197-237b-4e16-a8f2-b0df2c10824a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:21.041753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-c0d926cd-2755-4de6-a3d0-b84cf4c1bedb req-d46ca197-237b-4e16-a8f2-b0df2c10824a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.074801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:21.080884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-c0d926cd-2755-4de6-a3d0-b84cf4c1bedb req-d46ca197-237b-4e16-a8f2-b0df2c10824a service nova] Creating event network-vif-plugged:20f0b51d-9edf-437d-a233-3e26daa2ef7c for instance 12b3f033-5f36-4355-8221-ab55bcba8722 on hv-cinder-83979 May 12 17:43:21.088939 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a52fd3b4-8827-4c72-8007-77c848bd9774 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1549 microversion: 2.1 time: 0.366421 May 12 17:43:21.089534 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 44/95] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:20 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1549 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:21.097251 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-c0d926cd-2755-4de6-a3d0-b84cf4c1bedb req-d46ca197-237b-4e16-a8f2-b0df2c10824a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090067 May 12 17:43:21.102726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 52/96] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:43:21.106953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:21.108101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:21.111462 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-18643e10-5e83-4c7c-a58f-ba91fd2b3a99 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:21.116062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:21.116713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.117240 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-18643e10-5e83-4c7c-a58f-ba91fd2b3a99 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:21.119306 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:21.120254 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.139131 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-18643e10-5e83-4c7c-a58f-ba91fd2b3a99 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:21.139693 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-18643e10-5e83-4c7c-a58f-ba91fd2b3a99 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.140796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-18643e10-5e83-4c7c-a58f-ba91fd2b3a99 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:21.141772 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-18643e10-5e83-4c7c-a58f-ba91fd2b3a99 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.324160 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-18643e10-5e83-4c7c-a58f-ba91fd2b3a99 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.217680 May 12 17:43:21.325162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 53/97] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:43:21 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:21.403184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:21.415695 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-409e2089-9951-4620-b63e-3b2383c4c88f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.322026 May 12 17:43:21.417387 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 45/98] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:21 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:21.520823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:21.521433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:21.535478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:21.536295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.537354 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:21.538096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:21.975852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:21.991057 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:21.996775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:22.001712 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d2723820-5bdf-48ee-91db-040e9232d3a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.483423 May 12 17:43:22.003279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 54/99] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:21 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:22.434525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:22.454769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:22.477463 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:22.479180 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:22.480003 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:22.480451 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:22.737892 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:22.745602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9e20888a-5619-4ed5-bcde-3fcb11fde3e0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.315728 May 12 17:43:22.748226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 46/100] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:22 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:23.021667 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:23.022277 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:23.035490 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:23.036236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:23.037202 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:23.037822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:23.183116 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-5c2f1334-9ea8-4d15-8e0a-f4418832ae49 req-4e6ac497-df18-4a55-9bda-2ac78ea3e69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70784c5b-3ded-4e8a-ab43-6e738bf4eea5", "name": "network-vif-plugged", "status": "completed", "tag": "b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:23.193811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-5c2f1334-9ea8-4d15-8e0a-f4418832ae49 req-4e6ac497-df18-4a55-9bda-2ac78ea3e69b service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:23.194259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-5c2f1334-9ea8-4d15-8e0a-f4418832ae49 req-4e6ac497-df18-4a55-9bda-2ac78ea3e69b service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:23.225938 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-5c2f1334-9ea8-4d15-8e0a-f4418832ae49 req-4e6ac497-df18-4a55-9bda-2ac78ea3e69b service nova] Creating event network-vif-plugged:b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1 for instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 on hv-cinder-83979 May 12 17:43:23.244062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-5c2f1334-9ea8-4d15-8e0a-f4418832ae49 req-4e6ac497-df18-4a55-9bda-2ac78ea3e69b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060688 May 12 17:43:23.244062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 47/101] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:23.414760 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:23.427062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:23.432069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:23.434115 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5a5a747b-a0c5-4165-a868-4db927d3277e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1408 microversion: 2.20 time: 0.416650 May 12 17:43:23.439627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 55/102] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:23 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1408 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:23.765995 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:23.767153 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:23.779407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:23.780052 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:23.781319 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:23.781943 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:23.921100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-027d6866-c29d-4e1d-af9d-d205865118f7 req-9ef1c141-b228-42f8-ba07-46520c146ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92a89c3-a796-4a8b-9491-3f944bca5a9b", "tag": "dae83d1a-12ad-4d98-a4d1-13233ca983ae"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:23.934315 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-027d6866-c29d-4e1d-af9d-d205865118f7 req-9ef1c141-b228-42f8-ba07-46520c146ee4 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:23.934807 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-027d6866-c29d-4e1d-af9d-d205865118f7 req-9ef1c141-b228-42f8-ba07-46520c146ee4 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:23.951039 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-027d6866-c29d-4e1d-af9d-d205865118f7 req-9ef1c141-b228-42f8-ba07-46520c146ee4 service nova] Creating event network-changed:dae83d1a-12ad-4d98-a4d1-13233ca983ae for instance a92a89c3-a796-4a8b-9491-3f944bca5a9b on hv-cinder-83979 May 12 17:43:23.960370 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-027d6866-c29d-4e1d-af9d-d205865118f7 req-9ef1c141-b228-42f8-ba07-46520c146ee4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043010 May 12 17:43:23.963656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 56/103] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:23.986567 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:23.995539 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c24ac424-03d8-4e23-b47a-a862d26747f1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.233692 May 12 17:43:23.996359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 48/104] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:23 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:24.454980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:24.455578 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:24.463472 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:24.471447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:24.473874 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:24.480856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:24.696523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:24.707230 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:24.709284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:24.712472 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8a8675c1-2997-46d3-9034-3864b89aa2f8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1600 microversion: 2.20 time: 0.261269 May 12 17:43:24.713346 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 57/105] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:43:24 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1600 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:24.733967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d0391071-b7d4-4666-9ba1-8c6ed6282491 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:24.734808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d0391071-b7d4-4666-9ba1-8c6ed6282491 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:24.743471 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0391071-b7d4-4666-9ba1-8c6ed6282491 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:24.744520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0391071-b7d4-4666-9ba1-8c6ed6282491 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:24.745788 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0391071-b7d4-4666-9ba1-8c6ed6282491 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:24.746588 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0391071-b7d4-4666-9ba1-8c6ed6282491 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:24.932594 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d0391071-b7d4-4666-9ba1-8c6ed6282491 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.203866 May 12 17:43:24.940567 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 49/106] 10.222.0.76 () {60 vars in 1315 bytes} [Thu May 12 17:43:24 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:43:25.016719 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:25.017686 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:25.026837 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:25.027669 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:25.030383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:25.031016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:25.231449 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:25.239367 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1978590e-e833-42a4-ad9c-90ae84218409 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1367 microversion: 2.1 time: 0.227043 May 12 17:43:25.254325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 58/107] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:25 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:26.261867 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:26.262427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:26.272489 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:26.275437 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:26.276622 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:26.277288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:26.719018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:26.732056 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f940e6e5-7b58-4a35-96f1-db6c1b6026af tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1558 microversion: 2.1 time: 0.474534 May 12 17:43:26.745545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 50/108] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:26 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1558 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:26.752147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a5eb537d-14f2-49b7-b649-674d94a4c860 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:26.753474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a5eb537d-14f2-49b7-b649-674d94a4c860 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:26.775065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a5eb537d-14f2-49b7-b649-674d94a4c860 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:26.781565 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a5eb537d-14f2-49b7-b649-674d94a4c860 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:26.785478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a5eb537d-14f2-49b7-b649-674d94a4c860 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:26.786586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a5eb537d-14f2-49b7-b649-674d94a4c860 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:26.958661 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a5eb537d-14f2-49b7-b649-674d94a4c860 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211269 May 12 17:43:26.959443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 59/109] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:43:26 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:27.184514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-07361a43-b22a-424b-b9b2-348e2d28b056 req-2107c11e-a35f-4d98-970b-9729ffe35f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b3f033-5f36-4355-8221-ab55bcba8722", "tag": "20f0b51d-9edf-437d-a233-3e26daa2ef7c"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:27.224742 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-07361a43-b22a-424b-b9b2-348e2d28b056 req-2107c11e-a35f-4d98-970b-9729ffe35f46 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:27.225428 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-07361a43-b22a-424b-b9b2-348e2d28b056 req-2107c11e-a35f-4d98-970b-9729ffe35f46 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:27.261438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-07361a43-b22a-424b-b9b2-348e2d28b056 req-2107c11e-a35f-4d98-970b-9729ffe35f46 service nova] Creating event network-changed:20f0b51d-9edf-437d-a233-3e26daa2ef7c for instance 12b3f033-5f36-4355-8221-ab55bcba8722 on hv-cinder-83979 May 12 17:43:27.271867 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-07361a43-b22a-424b-b9b2-348e2d28b056 req-2107c11e-a35f-4d98-970b-9729ffe35f46 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092752 May 12 17:43:27.274933 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 51/110] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:29.146783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-17a005af-dac7-41fc-8c48-fd72008bbf31 req-684ad0d9-8c1a-49ba-941a-eaa263e16961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70784c5b-3ded-4e8a-ab43-6e738bf4eea5", "tag": "b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:29.175982 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-17a005af-dac7-41fc-8c48-fd72008bbf31 req-684ad0d9-8c1a-49ba-941a-eaa263e16961 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:29.179441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-17a005af-dac7-41fc-8c48-fd72008bbf31 req-684ad0d9-8c1a-49ba-941a-eaa263e16961 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:29.217998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-17a005af-dac7-41fc-8c48-fd72008bbf31 req-684ad0d9-8c1a-49ba-941a-eaa263e16961 service nova] Creating event network-changed:b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1 for instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 on hv-cinder-83979 May 12 17:43:29.243973 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-17a005af-dac7-41fc-8c48-fd72008bbf31 req-684ad0d9-8c1a-49ba-941a-eaa263e16961 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102172 May 12 17:43:29.245717 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 60/111] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:29.802633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:29.803580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:29.820920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:29.823214 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:29.824978 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:29.825769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:29.876876 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:43:30.111704 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-61a8fc80-8e83-4c7e-b019-0a95aa6aea00 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "DELETE /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 204 len: 0 microversion: 2.1 time: 0.313545 May 12 17:43:30.112279 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 52/112] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:43:29 2022] DELETE /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:43:30.123466 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:30.124504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:30.144511 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:30.144982 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:30.145798 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:30.146244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:30.412169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:30.424441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-73563b42-c345-4e9a-8b98-5896c67494df tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1553 microversion: 2.1 time: 0.307405 May 12 17:43:30.428576 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 61/113] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:30 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:31.447963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:31.449743 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:31.458092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:31.458712 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:31.459830 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:31.460348 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:31.609817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:31.618827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-49f74397-3804-49d4-9f9b-b32daeae8edd tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1553 microversion: 2.1 time: 0.176796 May 12 17:43:31.619602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 53/114] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:31 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:32.636625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:32.637233 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:32.643991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:32.644445 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:32.645222 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:32.645662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:32.793602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:32.801770 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-82814a1b-058d-4978-a5c4-9dda68fd5b27 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1553 microversion: 2.1 time: 0.169090 May 12 17:43:32.802328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 62/115] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:32 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:33.819883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:33.821174 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:33.827585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:33.828036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:33.828806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:33.829240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:33.960533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:33.970789 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c77ee9b3-7ab4-4446-885b-463579b0d401 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1553 microversion: 2.1 time: 0.155032 May 12 17:43:33.981809 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 54/116] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:33 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:34.989350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:34.990333 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:34.997177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:34.997646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:34.998418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:34.998914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:35.139658 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:35.147711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d3b8bdef-6db6-4426-ab07-3e723b30cc48 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1553 microversion: 2.1 time: 0.162468 May 12 17:43:35.148282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 63/117] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:34 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:35.669804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-5683a6d7-9fd7-44cf-804d-1a8e86ba62b4 req-df3f4f38-e07f-4c21-8996-97d2c2ced046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066ef2-7740-4910-b039-b7f9274ce2ec", "name": "network-vif-deleted", "tag": "30ffa323-c573-4419-9364-4adaabc825fa"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:35.700393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-5683a6d7-9fd7-44cf-804d-1a8e86ba62b4 req-df3f4f38-e07f-4c21-8996-97d2c2ced046 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:35.701167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-5683a6d7-9fd7-44cf-804d-1a8e86ba62b4 req-df3f4f38-e07f-4c21-8996-97d2c2ced046 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:35.717783 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-5683a6d7-9fd7-44cf-804d-1a8e86ba62b4 req-df3f4f38-e07f-4c21-8996-97d2c2ced046 service nova] Creating event network-vif-deleted:30ffa323-c573-4419-9364-4adaabc825fa for instance 12066ef2-7740-4910-b039-b7f9274ce2ec on hv-cinder-83979 May 12 17:43:35.723823 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-5683a6d7-9fd7-44cf-804d-1a8e86ba62b4 req-df3f4f38-e07f-4c21-8996-97d2c2ced046 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061724 May 12 17:43:35.725431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 55/118] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:36.172744 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:36.173522 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:36.193815 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:36.194504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:36.196561 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:36.197461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:36.241057 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:36.242410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:36.243391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lazy-loading 'fault' on Instance uuid 12066ef2-7740-4910-b039-b7f9274ce2ec {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:43:36.343162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6837a9c14d408c8b1da84f7862d144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502fa29d3bf3465d8616f5e9286733eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:36.357564 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f964e097-c721-49e3-8b65-0395f4c54b1f tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 200 len: 1351 microversion: 2.1 time: 0.195505 May 12 17:43:36.358701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 64/119] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:36 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:37.375777 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:37.376534 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:37.382647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:37.383916 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:37.384702 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:37.385344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:37.400050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] HTTP exception thrown: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Request method failure captured: May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec HTTP/1.1 May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcLJV48FboCubq54R0FuA4j8qWk9QCVv2LgMy0ZvhS-NFwOGRVwtYFMVwZ-8cxXZeUMlqy9jy7Dk-VxET6xwoa3Y0kQP5sHGsAUpGTB_8oSzrOFttYhU5C_VVXmwbnG1Bvyr5nGx4MzeX2-axSaTqvZDyCORzkBh9UICbh2AvQuHPM May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:43:37.405212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_502fa29d3bf3465d8616f5e9286733eb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-DeleteServersTestJSON-48733648 May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ee6837a9c14d408c8b1da84f7862d144 May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.406482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '12066ef2-7740-4910-b039-b7f9274ce2ec'} May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:43:37.407202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.408362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:37.409397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Returning 404 to user: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:43:37.409397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-09dc651e-9ae3-4594-89a3-1379d71b957b tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 404 len: 111 microversion: 2.1 time: 0.035319 May 12 17:43:37.409397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 56/120] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:37 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:43:37.518883 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:37.521308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:37.531048 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:37.531709 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:37.532640 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:37.533475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:37.548357 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] HTTP exception thrown: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Request method failure captured: May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec/os-volume_attachments HTTP/1.1 May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcLJV48FboCubq54R0FuA4j8qWk9QCVv2LgMy0ZvhS-NFwOGRVwtYFMVwZ-8cxXZeUMlqy9jy7Dk-VxET6xwoa3Y0kQP5sHGsAUpGTB_8oSzrOFttYhU5C_VVXmwbnG1Bvyr5nGx4MzeX2-axSaTqvZDyCORzkBh9UICbh2AvQuHPM May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:43:37.552653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_502fa29d3bf3465d8616f5e9286733eb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-DeleteServersTestJSON-48733648 May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ee6837a9c14d408c8b1da84f7862d144 May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.553792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'server_id': '12066ef2-7740-4910-b039-b7f9274ce2ec'} May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:43:37.554420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:37.556098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:37.557558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Returning 404 to user: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:43:37.557558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-77cde454-7dbc-49c3-a812-1902b5983d78 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040751 May 12 17:43:37.557558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 65/121] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:43:37 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:43:38.794385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:38.794976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:38.801385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:38.802061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:38.802874 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:38.803317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:38.821001 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] HTTP exception thrown: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Request method failure captured: May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: DELETE /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec HTTP/1.1 May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcLJV48FboCubq54R0FuA4j8qWk9QCVv2LgMy0ZvhS-NFwOGRVwtYFMVwZ-8cxXZeUMlqy9jy7Dk-VxET6xwoa3Y0kQP5sHGsAUpGTB_8oSzrOFttYhU5C_VVXmwbnG1Bvyr5nGx4MzeX2-axSaTqvZDyCORzkBh9UICbh2AvQuHPM May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:43:38.822575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_502fa29d3bf3465d8616f5e9286733eb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-DeleteServersTestJSON-48733648 May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ee6837a9c14d408c8b1da84f7862d144 May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.824084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '12066ef2-7740-4910-b039-b7f9274ce2ec'} May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:43:38.824825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.826203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:43:38.827606 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Returning 404 to user: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:43:38.827606 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ea1c56e2-1566-4074-ba4d-586836028edb tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "DELETE /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 404 len: 111 microversion: 2.1 time: 0.034840 May 12 17:43:38.827606 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 57/122] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:43:38 2022] DELETE /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:43:38.832544 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:38.833166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] [instance: 12066ef2-7740-4910-b039-b7f9274ce2ec] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:38.840733 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:38.841118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:38.841902 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:38.842345 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:38.856341 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] HTTP exception thrown: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Request method failure captured: May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec HTTP/1.1 May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcLJV48FboCubq54R0FuA4j8qWk9QCVv2LgMy0ZvhS-NFwOGRVwtYFMVwZ-8cxXZeUMlqy9jy7Dk-VxET6xwoa3Y0kQP5sHGsAUpGTB_8oSzrOFttYhU5C_VVXmwbnG1Bvyr5nGx4MzeX2-axSaTqvZDyCORzkBh9UICbh2AvQuHPM May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:43:38.858652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_502fa29d3bf3465d8616f5e9286733eb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/502fa29d3bf3465d8616f5e9286733eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-DeleteServersTestJSON-48733648 May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 502fa29d3bf3465d8616f5e9286733eb May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-DeleteServersTestJSON-48733648 May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ee6837a9c14d408c8b1da84f7862d144 May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-DeleteServersTestJSON-48733648-project May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.860053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '12066ef2-7740-4910-b039-b7f9274ce2ec'} May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:43:38.860753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. May 12 17:43:38.861912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:43:38.863287 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] Returning 404 to user: Instance 12066ef2-7740-4910-b039-b7f9274ce2ec could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:43:38.863287 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ae647089-7695-448f-8167-f004a8993405 tempest-DeleteServersTestJSON-48733648 tempest-DeleteServersTestJSON-48733648-project] 10.222.0.76 "GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec" status: 404 len: 111 microversion: 2.1 time: 0.031230 May 12 17:43:38.863287 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 66/123] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:38 2022] GET /compute/v2.1/servers/12066ef2-7740-4910-b039-b7f9274ce2ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:43:47.021476 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1604096408", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:47.080408 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] validate_networks() for [('c2308c9c-cbd7-48e8-a900-0d956d07aa27', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:43:47.566032 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:43:47.566459 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:43:47.567012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:43:47.568272 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:43:47.568804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:43:47.580780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:47.581228 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:47.582491 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:47.583200 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:47.601508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for project bcee5099fd2b4df2adaa069af3a45733. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:43:47.607076 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for user ee532b08897148dd9ff0482a00f537f7 and project bcee5099fd2b4df2adaa069af3a45733. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:43:47.621650 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:43:47.624203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:43:47.685375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-af5051cb-4353-4de6-8ed7-19a82604a93d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.971659 May 12 17:43:47.691232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 58/124] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:43:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:43:47.697715 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-744478c1-34fe-4cc5-8d28-124b7c60f404 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:47.698586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-744478c1-34fe-4cc5-8d28-124b7c60f404 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:47.769465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-744478c1-34fe-4cc5-8d28-124b7c60f404 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:47.777425 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-744478c1-34fe-4cc5-8d28-124b7c60f404 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1222 microversion: 2.1 time: 0.084657 May 12 17:43:47.778822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 67/125] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:47 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:47.957292 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-85848593", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:48.046484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] validate_networks() for [('c2308c9c-cbd7-48e8-a900-0d956d07aa27', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:43:48.718484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:43:48.718925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:43:48.719395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:43:48.720055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:43:48.720874 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:43:48.735814 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:48.736530 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:48.737364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:48.738001 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:48.780103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for project bcee5099fd2b4df2adaa069af3a45733. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:43:48.785736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for user ee532b08897148dd9ff0482a00f537f7 and project bcee5099fd2b4df2adaa069af3a45733. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:43:48.799423 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:43:48.801609 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:43:48.849000 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-590f0258-c23a-4273-b838-1c1163226d16 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.896649 May 12 17:43:48.849897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 59/126] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:43:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:43:48.860089 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-87af5464-564c-4f6f-bce5-3d9db94ff035 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:48.861249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-87af5464-564c-4f6f-bce5-3d9db94ff035 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:49.249742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-87af5464-564c-4f6f-bce5-3d9db94ff035 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:49.263991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-87af5464-564c-4f6f-bce5-3d9db94ff035 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1220 microversion: 2.1 time: 0.401401 May 12 17:43:49.276029 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 68/127] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:48 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1220 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:50.283788 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:50.285079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:50.298034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:50.298780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:50.300161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:50.300827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:50.453169 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:50.471980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-85fa02bd-9f51-4f47-a4dc-03d2fcb173bf tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1272 microversion: 2.1 time: 0.193728 May 12 17:43:50.478064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 60/128] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:50 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:51.499722 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:51.501972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:51.516898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:51.518352 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:51.522524 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:51.523226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:51.656950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:51.665679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cd71ced2-a2e7-4554-9cfa-0999fe728f31 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1278 microversion: 2.1 time: 0.174290 May 12 17:43:51.666263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 69/129] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:51 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:43:52.348737 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-3eec271b-f14d-4697-92e3-e0fd36cee9d0 req-d29fe021-1b9c-422b-9d57-3f3945f68a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9fe1954-0d79-4a7b-a18f-463a1e44b42a", "tag": "63804ffd-8d9a-4673-82b0-a8a919c81e0c"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:52.364289 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-3eec271b-f14d-4697-92e3-e0fd36cee9d0 req-d29fe021-1b9c-422b-9d57-3f3945f68a23 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:52.365098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-3eec271b-f14d-4697-92e3-e0fd36cee9d0 req-d29fe021-1b9c-422b-9d57-3f3945f68a23 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:52.384435 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-3eec271b-f14d-4697-92e3-e0fd36cee9d0 req-d29fe021-1b9c-422b-9d57-3f3945f68a23 service nova] Creating event network-changed:63804ffd-8d9a-4673-82b0-a8a919c81e0c for instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a on hv-cinder-83979 May 12 17:43:52.391493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-3eec271b-f14d-4697-92e3-e0fd36cee9d0 req-d29fe021-1b9c-422b-9d57-3f3945f68a23 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051218 May 12 17:43:52.392604 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 61/130] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:52.684621 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:52.685247 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:52.703970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:52.704442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:52.705249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:52.705689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:52.985554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:52.998952 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-370fdf84-a1ef-453f-a259-992dd403cb5d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.318972 May 12 17:43:53.001707 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 70/131] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:52 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:53.768811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-26946b3f-ebe4-436b-a54d-3e5d559d05df req-ace2ad2c-3ee7-44ce-bab3-3b05b0174698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c977bb-536a-402e-9bb1-f6f30944d7d1", "tag": "ddbcad82-027a-4849-b06e-806434038d9b"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:53.781088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-26946b3f-ebe4-436b-a54d-3e5d559d05df req-ace2ad2c-3ee7-44ce-bab3-3b05b0174698 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:53.781825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-26946b3f-ebe4-436b-a54d-3e5d559d05df req-ace2ad2c-3ee7-44ce-bab3-3b05b0174698 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:53.799338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-26946b3f-ebe4-436b-a54d-3e5d559d05df req-ace2ad2c-3ee7-44ce-bab3-3b05b0174698 service nova] Creating event network-changed:ddbcad82-027a-4849-b06e-806434038d9b for instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 on hv-cinder-83979 May 12 17:43:53.808432 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-26946b3f-ebe4-436b-a54d-3e5d559d05df req-ace2ad2c-3ee7-44ce-bab3-3b05b0174698 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050181 May 12 17:43:53.809605 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 62/132] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:54.019820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:54.020627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:54.029190 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:54.029808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:54.032096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:54.032909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:54.170362 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:54.178061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-21a892f8-a48b-428b-8422-b3cd3a305470 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.163805 May 12 17:43:54.178719 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 71/133] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:54 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:55.196170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:55.197434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:55.213882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:55.214349 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:55.215167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:55.215605 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:55.415109 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:55.423418 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3148155d-ba8e-4f97-8e8d-2b4051e1268a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.231969 May 12 17:43:55.423911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 63/134] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:55 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:56.442067 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:56.442714 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:56.457685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:56.458175 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:56.458956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:56.459730 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:56.610649 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:56.619527 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-92c384d7-2aea-4e90-826b-af114d58d123 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.181906 May 12 17:43:56.620098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 72/135] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:56 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:57.636616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:57.637223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:57.643446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:57.643901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:57.644676 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:57.645116 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:57.785526 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:57.794985 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0dd4ba5b-c30f-4922-9687-0a2f27adf0f6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.162393 May 12 17:43:57.795753 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 64/136] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:57 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:58.811648 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:58.812342 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:58.819137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:58.819698 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:58.821187 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:58.821630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:58.961271 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:43:58.969907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ffefdc07-04a2-49de-8659-1e48db4a008f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.162176 May 12 17:43:58.970630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 73/137] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:58 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:43:59.026256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-bda40506-cfba-493c-b5dd-a899283f68c7 req-8cc180f4-8c22-4af7-9b1f-3787e8cc2ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9fe1954-0d79-4a7b-a18f-463a1e44b42a", "name": "network-vif-plugged", "status": "completed", "tag": "63804ffd-8d9a-4673-82b0-a8a919c81e0c"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:43:59.039813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bda40506-cfba-493c-b5dd-a899283f68c7 req-8cc180f4-8c22-4af7-9b1f-3787e8cc2ef9 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:59.040604 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bda40506-cfba-493c-b5dd-a899283f68c7 req-8cc180f4-8c22-4af7-9b1f-3787e8cc2ef9 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:59.053048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-bda40506-cfba-493c-b5dd-a899283f68c7 req-8cc180f4-8c22-4af7-9b1f-3787e8cc2ef9 service nova] Creating event network-vif-plugged:63804ffd-8d9a-4673-82b0-a8a919c81e0c for instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a on hv-cinder-83979 May 12 17:43:59.059201 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-bda40506-cfba-493c-b5dd-a899283f68c7 req-8cc180f4-8c22-4af7-9b1f-3787e8cc2ef9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036917 May 12 17:43:59.059796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 65/138] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:59.987423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:59.988125 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:43:59.995392 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:59.995847 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:59.996624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:59.997062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:00.273998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:00.281516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-186afda1-9d2a-436f-a920-11887329d85d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.297777 May 12 17:44:00.282018 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 74/139] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:43:59 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:01.075276 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-bec94173-7eda-499c-9530-94446913645d req-beabc27c-8c8d-480f-a5a0-95d4ad35f078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c977bb-536a-402e-9bb1-f6f30944d7d1", "name": "network-vif-plugged", "status": "completed", "tag": "ddbcad82-027a-4849-b06e-806434038d9b"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:01.098222 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bec94173-7eda-499c-9530-94446913645d req-beabc27c-8c8d-480f-a5a0-95d4ad35f078 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:01.098222 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bec94173-7eda-499c-9530-94446913645d req-beabc27c-8c8d-480f-a5a0-95d4ad35f078 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:01.108297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-bec94173-7eda-499c-9530-94446913645d req-beabc27c-8c8d-480f-a5a0-95d4ad35f078 service nova] Creating event network-vif-plugged:ddbcad82-027a-4849-b06e-806434038d9b for instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 on hv-cinder-83979 May 12 17:44:01.121780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-bec94173-7eda-499c-9530-94446913645d req-beabc27c-8c8d-480f-a5a0-95d4ad35f078 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043150 May 12 17:44:01.122595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 66/140] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:01.298376 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:01.300598 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:01.308015 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:01.308551 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:01.309400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:01.309843 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:01.453026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:01.462765 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ff4645ca-ea98-43e7-8492-d30564a86083 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.167898 May 12 17:44:01.463342 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 75/141] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:01 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:02.490097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:02.491003 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:02.502561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:02.503598 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:02.504958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:02.505815 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:02.642131 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:02.649843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-601d657b-61be-49d8-be73-d9374211f36a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.164929 May 12 17:44:02.650400 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 67/142] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:02 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:03.667284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:03.667864 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:03.675359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:03.676021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:03.677198 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:03.677922 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:03.821968 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:03.831908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-73eab1e2-9299-4cd5-a2cc-71e0a950a7e1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1320 microversion: 2.1 time: 0.169343 May 12 17:44:03.832470 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 76/143] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:03 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:04.849980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:04.850587 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:04.858149 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:04.858612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:04.859434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:04.859869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:04.993612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:05.000824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-64d9e55a-d48a-4c82-94ff-d1de07751c69 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1513 microversion: 2.1 time: 0.154685 May 12 17:44:05.001395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 68/144] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:04 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:05.017796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:05.018757 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:05.025248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:05.025731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:05.026518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:05.027023 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:05.052396 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lazy-loading 'flavor' on Instance uuid b8c977bb-536a-402e-9bb1-f6f30944d7d1 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:44:05.177124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0ce03313-9634-4a12-b581-c0f5cee26262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1/action" status: 200 len: 32 microversion: 2.1 time: 0.163284 May 12 17:44:05.183265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 77/145] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:44:05 2022] POST /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:44:05.191944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:05.192528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:05.200369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:05.200924 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:05.201718 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:05.202158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:05.362549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:05.370531 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-42be2d9e-b5e6-4657-8a35-a43ebf77e7e2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.182543 May 12 17:44:05.371142 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 69/146] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:05 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:06.388414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:06.389118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:06.396814 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:06.397272 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:06.398243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:06.399755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:06.538724 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:06.545091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-192e3fc4-668c-4605-a665-9deb712d9bb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.161076 May 12 17:44:06.545839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 78/147] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:06 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:07.562553 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:07.563869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:07.570138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:07.572170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:07.573033 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:07.573559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:07.884533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:07.894333 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-aec8ee6e-dabe-4626-b312-23473a15d529 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.335563 May 12 17:44:07.895163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 70/148] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:07 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:08.911497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:08.912095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:08.919869 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:08.920568 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:08.921357 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:08.921783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:09.060542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:09.079677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d763ff76-f6ca-4d5c-ae37-9e5228036946 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.171821 May 12 17:44:09.090768 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 79/149] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:08 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:10.102317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:10.105285 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:10.111906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:10.112356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:10.113119 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:10.113738 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:10.377386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:10.385467 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c654c106-37be-46ff-8245-00457f3c4b3d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.290814 May 12 17:44:10.386188 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 71/150] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:10 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:11.411942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:11.412679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:11.420333 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:11.420791 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:11.421572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:11.422006 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:11.585968 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:11.595237 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-aab02eeb-2916-4643-ad11-20f9fecf4061 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.195604 May 12 17:44:11.596353 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 80/151] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:11 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:12.612939 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:12.613854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:12.621581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:12.622040 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:12.622866 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:12.623308 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:12.856157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:12.866138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ec3bdce7-301d-40b8-b2b6-82aa6d7ad76b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.257081 May 12 17:44:12.868426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 72/152] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:12 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:13.886184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:13.887973 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:13.921427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:13.928361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:13.934795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:13.935796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:14.161223 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:14.176421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-87f3f839-dfca-4341-bd10-6e2b60cd144c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.295491 May 12 17:44:14.178076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 81/153] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:13 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:15.201409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:15.202710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:15.214489 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:15.216748 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:15.217988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:15.218590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:15.704562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:15.729212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-437420f8-4f09-4a07-ae28-500e228b5db4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.533701 May 12 17:44:15.729879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 73/154] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:15 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:16.753915 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:16.754546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:16.778115 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:16.778805 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:16.781479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:16.782041 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:17.052304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:17.073940 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-78cc21ff-80e1-4b9e-b4e0-0f433e151b8a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.330929 May 12 17:44:17.074542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 82/155] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:16 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:17.613976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2c6d3446-96cf-4211-83b5-4b52ed862f68 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Action: 'create', calling method: .version_select at 0x7f24bc727160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-235511178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTFJOtSpaMRYortBL4eWLX/9m3JOQEhU4npFlqOp9ugxNPv88EbozwOOkdvdlMd9pWQ29Gp390YIOjJdcPmbdQp5TcrzfR1NaqtX//v9jPbQlT42xPyz60/ZWE9+D+Xqg=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:17.628866 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-2c6d3446-96cf-4211-83b5-4b52ed862f68 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:44:17.633272 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-2c6d3446-96cf-4211-83b5-4b52ed862f68 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for user 7802c329d4ca4eccb28fdec9f8082cc1 and project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:44:17.661221 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2c6d3446-96cf-4211-83b5-4b52ed862f68 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.248652 May 12 17:44:17.661981 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 74/156] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:44:17 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:18.091869 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:18.093219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:18.100121 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:18.100501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:18.101811 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:18.102443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:18.147580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1587727130", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "networks": [{"uuid": "06e9bf4a-dfcc-439e-b76a-6285d33f5dcb"}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:18.210537 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] validate_networks() for [('06e9bf4a-dfcc-439e-b76a-6285d33f5dcb', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:44:18.315169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:18.324663 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-582e16fd-1e47-4dbf-b9ff-05a106842659 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.236899 May 12 17:44:18.330711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 83/157] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:18 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:18.855942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:44:18.856415 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:44:18.856818 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:44:18.857223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:44:18.857632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:44:18.867793 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:18.868360 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:18.869482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:18.869929 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:18.899718 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Getting quotas for project 5efa2685b0ca4a4e86626fddbd68e4ed. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:44:18.904431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Getting quotas for user 588930f5618c4d7d92de82a89a17d923 and project 5efa2685b0ca4a4e86626fddbd68e4ed. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:44:18.917620 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:44:18.919925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:44:18.972899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-760e164e-1d0e-4cdf-807d-a383cb893ebc tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829477 May 12 17:44:18.974169 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 75/158] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:44:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:44:18.985110 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9fdd32a8-7154-42e6-bac9-7b765da79807 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:18.985721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9fdd32a8-7154-42e6-bac9-7b765da79807 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:19.058613 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9fdd32a8-7154-42e6-bac9-7b765da79807 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:19.067608 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9fdd32a8-7154-42e6-bac9-7b765da79807 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1219 microversion: 2.1 time: 0.085837 May 12 17:44:19.075478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 84/159] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:18 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:19.343584 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:19.344661 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:19.356310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:19.356774 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:19.357567 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:19.364084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:19.560989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:19.569067 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6efd16d7-940d-4a3d-abb4-951c9a658728 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.229258 May 12 17:44:19.579879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 76/160] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:19 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:20.086522 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:20.087518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:20.101385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:20.101850 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:20.102649 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:20.103132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:20.182106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:20.190630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-661aa526-93d3-4e70-9a1e-5ba9c5f3b853 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1271 microversion: 2.1 time: 0.108694 May 12 17:44:20.191759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 85/161] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:20 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:20.587500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:20.588094 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:20.597541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:20.598633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:20.600885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:20.613634 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:20.920870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:20.940309 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1bfb16ff-5e45-49e8-9e99-576ad2b01b1b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.357002 May 12 17:44:20.940901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 77/162] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:20 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:21.209036 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:21.209645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:21.217406 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:21.218230 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:21.219420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:21.220077 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:21.303153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:21.312361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b1ce52a3-b524-4263-ad4d-018235b9349f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1277 microversion: 2.1 time: 0.107235 May 12 17:44:21.313393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 86/163] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:21 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:21.959552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:21.961641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:21.973261 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:21.977252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:21.978176 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:21.978633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:22.212173 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:22.221705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d00a7921-2581-4fc4-bf8d-eaa4117322bb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.266288 May 12 17:44:22.222730 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 78/164] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:21 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:22.329485 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:22.330092 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:22.337907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:22.338701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:22.339710 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:22.340391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:22.457102 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-0fc25721-2760-4f7c-9e96-e431199b4b2c req-1a7dca6c-7e1c-4daa-9804-fb0869ab717f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c187f64c-8f0e-49e9-af9c-09fcad26bec4", "tag": "27eca0e5-f3eb-4a6d-be1d-b05246bdf746"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:22.487798 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:22.488150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-0fc25721-2760-4f7c-9e96-e431199b4b2c req-1a7dca6c-7e1c-4daa-9804-fb0869ab717f service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:22.488866 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-0fc25721-2760-4f7c-9e96-e431199b4b2c req-1a7dca6c-7e1c-4daa-9804-fb0869ab717f service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:22.502549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-0fc25721-2760-4f7c-9e96-e431199b4b2c req-1a7dca6c-7e1c-4daa-9804-fb0869ab717f service nova] Creating event network-changed:27eca0e5-f3eb-4a6d-be1d-b05246bdf746 for instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 on hv-cinder-83979 May 12 17:44:22.508271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-0fc25721-2760-4f7c-9e96-e431199b4b2c req-1a7dca6c-7e1c-4daa-9804-fb0869ab717f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056064 May 12 17:44:22.509963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 79/165] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:22.517854 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5e5e5bc2-2387-4eb8-a294-ded5ac96ac2c tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.191913 May 12 17:44:22.525072 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 87/166] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:22 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:22.966763 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cf5fca24-f759-47b3-95d4-e3f17a066f0b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:22.967291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-cf5fca24-f759-47b3-95d4-e3f17a066f0b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:22.980808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5fca24-f759-47b3-95d4-e3f17a066f0b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:22.981753 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5fca24-f759-47b3-95d4-e3f17a066f0b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:22.982550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5fca24-f759-47b3-95d4-e3f17a066f0b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:22.983120 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf5fca24-f759-47b3-95d4-e3f17a066f0b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:23.008331 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-cf5fca24-f759-47b3-95d4-e3f17a066f0b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/ips" status: 200 len: 152 microversion: 2.20 time: 0.051394 May 12 17:44:23.008821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 80/167] 10.222.0.76 () {60 vars in 1288 bytes} [Thu May 12 17:44:22 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:44:23.239427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:23.240448 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:23.248169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:23.248623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:23.249404 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:23.249853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:23.423918 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:23.434662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6e5a545f-57b4-4cf3-a50b-7f42e0ba3751 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.198821 May 12 17:44:23.443165 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 88/168] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:23 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:23.537146 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:23.537769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:23.543807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:23.544391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:23.545020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:23.545449 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:23.709111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:23.717163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5f5be965-7488-4e63-9d8a-7a6ba692d0da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.183962 May 12 17:44:23.720292 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 81/169] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:23 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:24.450547 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:24.451188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:24.458034 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:24.458515 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:24.459330 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:24.463947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:24.594863 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:24.602987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0c06cd0c-f976-45f5-b206-4a929f2d3e59 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.156327 May 12 17:44:24.603572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 89/170] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:24 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:24.735013 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:24.735533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:24.741389 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:24.741916 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:24.742653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:24.743131 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:24.918757 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:24.925994 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-31a20ae7-ade8-4b8f-a6b6-1a0d4254cd12 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.194966 May 12 17:44:24.926557 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 82/171] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:24 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:25.026213 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-daf99340-ff4d-4634-b891-a4d982a96d2f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:25.026734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-daf99340-ff4d-4634-b891-a4d982a96d2f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:25.032742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf99340-ff4d-4634-b891-a4d982a96d2f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.033191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf99340-ff4d-4634-b891-a4d982a96d2f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:25.034001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf99340-ff4d-4634-b891-a4d982a96d2f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.034432 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf99340-ff4d-4634-b891-a4d982a96d2f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:25.057931 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-daf99340-ff4d-4634-b891-a4d982a96d2f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/ips" status: 200 len: 151 microversion: 2.1 time: 0.035793 May 12 17:44:25.058509 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 90/172] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:44:25 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:25.069170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-742344891", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "networks": [{"uuid": "72ed361c-ef6b-4562-85b5-0e16d11b9029"}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:25.121986 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] validate_networks() for [('72ed361c-ef6b-4562-85b5-0e16d11b9029', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:44:25.497286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:44:25.497708 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:44:25.498180 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:44:25.498587 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:44:25.499030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:44:25.508366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.508749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:25.509558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.510001 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:25.527815 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Getting quotas for project 75736e80e44a481484d88e394c5269d6. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:44:25.531744 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Getting quotas for user 967a537eb434465e8294c324a83ef5b0 and project 75736e80e44a481484d88e394c5269d6. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:44:25.542449 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:44:25.544707 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:44:25.589885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c1ef2185-42d3-4d42-a188-0521c7f07999 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524490 May 12 17:44:25.590528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 83/173] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:44:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:44:25.600332 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1184e0e0-cb9d-403c-b599-a50f2ca20256 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:25.600941 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1184e0e0-cb9d-403c-b599-a50f2ca20256 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:25.621092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:25.621717 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:25.631646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.632100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:25.633220 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.633664 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:25.657182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1184e0e0-cb9d-403c-b599-a50f2ca20256 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:25.664674 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1184e0e0-cb9d-403c-b599-a50f2ca20256 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1213 microversion: 2.1 time: 0.067600 May 12 17:44:25.665603 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 91/174] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:25 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:25.784973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:25.792859 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c0ecea7e-2fd2-4791-aaee-384c6e13cc87 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.176727 May 12 17:44:25.793419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 84/175] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:25 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:25.946081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:25.946736 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:25.952873 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.953330 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:25.954109 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:25.954663 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:26.094088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:26.102759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-74eb56c7-67e6-4e40-8561-1cc43cee33f1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.163009 May 12 17:44:26.103754 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 92/176] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:25 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:26.425541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-81f88e8a-300c-421c-acab-8917026910c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03264093-de87-4565-b871-cf629c92da97"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:26.426725 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-81f88e8a-300c-421c-acab-8917026910c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:26.433750 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f88e8a-300c-421c-acab-8917026910c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:26.434236 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f88e8a-300c-421c-acab-8917026910c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:26.435052 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f88e8a-300c-421c-acab-8917026910c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:26.435490 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f88e8a-300c-421c-acab-8917026910c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:26.686241 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:26.687267 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:26.694150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:26.694783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:26.696451 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:26.696956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:26.795235 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:26.815805 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-99c7d2da-8f33-44c9-af8f-c0bceefd67b7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1265 microversion: 2.1 time: 0.137115 May 12 17:44:26.826261 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 93/177] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:26 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:26.837711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:26.838574 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:26.845014 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:26.845748 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:26.847002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:26.847748 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:26.974403 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-81f88e8a-300c-421c-acab-8917026910c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552594 May 12 17:44:26.980246 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 85/178] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:44:26 2022] POST /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 194 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:27.043917 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:27.066300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d2a509b0-8783-420e-9e46-97f101276b43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.224655 May 12 17:44:27.067278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 94/179] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:26 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:27.123038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:27.124833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:27.131047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:27.131488 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:27.132531 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:27.133220 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:27.336648 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:27.344280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5d11e74f-6ba1-4c2b-b656-f8e013e6766f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.227099 May 12 17:44:27.344938 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 86/180] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:27 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:27.833101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:27.835979 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:27.842733 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:27.843187 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:27.843964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:27.844396 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:27.978497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:27.985705 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5728b2e5-03bf-4213-9fb1-c8d861a63e9a tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.156379 May 12 17:44:27.986305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 95/181] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:27 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:28.075777 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:28.076299 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:28.084207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:28.088260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.088724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.090355 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:28.092185 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.092826 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.104852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.105310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.106094 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.106535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.135931 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lazy-loading 'flavor' on Instance uuid 12b3f033-5f36-4355-8221-ab55bcba8722 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:44:28.279241 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:28.291562 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cc253dc8-d7a1-49cf-9e31-784a1cd99bec tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.210886 May 12 17:44:28.293075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 96/182] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:28 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:28.330017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-426c9d52-9053-42c7-80c2-728b9dca5f04 req-66a0d8a8-ab7b-4256-9a21-dff71fa8b8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b227b1-c2a6-43c9-83dc-b056690fb302", "tag": "2a43a5b7-d5f3-49fe-b099-b75fafbd237a"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:28.340119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-426c9d52-9053-42c7-80c2-728b9dca5f04 req-66a0d8a8-ab7b-4256-9a21-dff71fa8b8e5 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.340811 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-426c9d52-9053-42c7-80c2-728b9dca5f04 req-66a0d8a8-ab7b-4256-9a21-dff71fa8b8e5 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.352944 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-426c9d52-9053-42c7-80c2-728b9dca5f04 req-66a0d8a8-ab7b-4256-9a21-dff71fa8b8e5 service nova] Creating event network-changed:2a43a5b7-d5f3-49fe-b099-b75fafbd237a for instance 85b227b1-c2a6-43c9-83dc-b056690fb302 on hv-cinder-83979 May 12 17:44:28.365238 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-426c9d52-9053-42c7-80c2-728b9dca5f04 req-66a0d8a8-ab7b-4256-9a21-dff71fa8b8e5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039642 May 12 17:44:28.365851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 97/183] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:44:28.372095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:28.372786 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:28.379389 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.379848 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.380615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.381053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.470327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c275ede9-318f-46da-a7c9-72415e8569b8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/action" status: 202 len: 0 microversion: 2.20 time: 0.398835 May 12 17:44:28.473925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 87/184] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 12 17:44:28 2022] POST /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:44:28.479661 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:28.480347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:28.489239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.489239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.489239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.489239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.519420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:28.527747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7ab27867-7f03-4fed-9ca3-3a5f99758a1e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.160481 May 12 17:44:28.528344 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 98/185] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:28 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:28.657117 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:28.665836 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:28.667371 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:28.668531 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-eef2b9f7-63fe-4fe0-a6b8-5ecb1660aac4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.193318 May 12 17:44:28.669081 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 88/186] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:28 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:28.963719 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-1c1edd8d-ba23-4dcc-a93a-f079ef7f3f69 req-3df5374b-8f70-4e66-abe4-dcfc8210141f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c187f64c-8f0e-49e9-af9c-09fcad26bec4", "name": "network-vif-plugged", "status": "completed", "tag": "27eca0e5-f3eb-4a6d-be1d-b05246bdf746"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:28.974337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-1c1edd8d-ba23-4dcc-a93a-f079ef7f3f69 req-3df5374b-8f70-4e66-abe4-dcfc8210141f service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:28.974988 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-1c1edd8d-ba23-4dcc-a93a-f079ef7f3f69 req-3df5374b-8f70-4e66-abe4-dcfc8210141f service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:28.988141 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-1c1edd8d-ba23-4dcc-a93a-f079ef7f3f69 req-3df5374b-8f70-4e66-abe4-dcfc8210141f service nova] Creating event network-vif-plugged:27eca0e5-f3eb-4a6d-be1d-b05246bdf746 for instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 on hv-cinder-83979 May 12 17:44:28.993343 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-1c1edd8d-ba23-4dcc-a93a-f079ef7f3f69 req-3df5374b-8f70-4e66-abe4-dcfc8210141f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 May 12 17:44:28.994203 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 99/187] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:29.003379 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:29.003988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:29.018818 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.024574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.025381 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.025829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.309468 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:29.310167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:29.316414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.316868 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.317651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.318096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.459058 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:29.467392 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a4c3d5e2-9c9e-4608-ad66-67d05c5986ab tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.162124 May 12 17:44:29.467970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 100/188] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:29 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:29.469275 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:29.477151 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ae55c2d4-959c-45ee-9926-66fc8a196198 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.477657 May 12 17:44:29.477804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 89/189] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:28 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:29.544924 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:29.545527 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:29.551504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.551964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.552726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.553163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.588539 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-53321674-2064-4561-be0a-783693eb1492 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:29.589117 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-53321674-2064-4561-be0a-783693eb1492 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:29.595738 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53321674-2064-4561-be0a-783693eb1492 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.596187 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53321674-2064-4561-be0a-783693eb1492 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.597242 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53321674-2064-4561-be0a-783693eb1492 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.597682 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53321674-2064-4561-be0a-783693eb1492 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.622159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-53321674-2064-4561-be0a-783693eb1492 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/ips" status: 200 len: 147 microversion: 2.1 time: 0.037714 May 12 17:44:29.629069 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 90/190] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:44:29 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:44:29.687801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:29.688017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:29.688756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:29.694752 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.695792 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.696040 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-427a6e41-003b-4e43-bca3-3ddceae5a018 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.154268 May 12 17:44:29.696680 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:29.697044 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 101/191] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:29 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:29.697196 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:29.829455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:29.837391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:29.838919 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:29.840066 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8a960150-1700-4bf8-aa03-d66f5cc614af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.157151 May 12 17:44:29.840619 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 91/192] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:29 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:30.484656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:30.485174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:30.491578 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.492646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.493421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.493855 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.494098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:30.494730 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:30.500622 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.501070 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.502281 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.502991 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.667269 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:30.668465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:30.679065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-433ddb83-9c27-4407-ade8-16984db2f5f1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.189558 May 12 17:44:30.679816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-bfc570d8-26ec-45b8-84d4-35c09b91d6b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.198893 May 12 17:44:30.680154 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 92/193] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:30 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:30.681470 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 102/194] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:30 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:30.713684 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:30.714284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:30.721355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.721882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.723091 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.723819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.860691 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:30.861301 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:30.867785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.868242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.869021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:30.869458 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:30.870104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:30.878368 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2ec2c32c-6987-40e8-a40b-de843783aafd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.168765 May 12 17:44:30.879008 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 93/195] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:30 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:31.020830 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:31.029996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:31.031541 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:31.033025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c3ca34a0-2308-4c8d-83f0-8da2b2039ea6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.176463 May 12 17:44:31.033907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 103/196] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:30 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:31.698069 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:31.699282 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:31.707924 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:31.708518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:31.716594 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:31.717089 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:31.717832 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:31.718272 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:31.718743 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:31.719193 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:31.719958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:31.720385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:31.866456 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:31.877084 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f125c23e-a485-4f1a-8f79-8a2d3da43ee8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.172841 May 12 17:44:31.877986 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 104/197] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:31 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:31.899085 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:31.899760 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:31.906142 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:31.908899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:31.909753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:31.910221 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:32.026024 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:32.038406 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-01ebbf5a-779b-457a-8fc4-9300327f3621 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.344843 May 12 17:44:32.040198 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 94/198] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:31 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:32.047980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:32.053923 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:32.056771 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:32.057820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-65341cd1-36fc-4f97-8faf-bdf0bb3a341b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1319 microversion: 2.1 time: 0.163198 May 12 17:44:32.063833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:32.064291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:32.065067 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:32.065663 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:32.069373 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 105/199] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:31 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:32.207151 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:32.215360 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:32.216876 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:32.218034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-10eff888-b027-4e0d-a967-282a0dae7822 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.167947 May 12 17:44:32.218582 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 95/200] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:32 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:32.437620 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-bf344add-be99-44fc-8650-72daacd563b4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5945be37-a201-47f9-99ef-0965e61df60e"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:32.438742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-bf344add-be99-44fc-8650-72daacd563b4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:32.444565 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bf344add-be99-44fc-8650-72daacd563b4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:32.446262 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bf344add-be99-44fc-8650-72daacd563b4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:32.447067 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bf344add-be99-44fc-8650-72daacd563b4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:32.447503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bf344add-be99-44fc-8650-72daacd563b4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:32.896476 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:32.897188 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:32.904775 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:32.905333 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:32.906237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:32.906923 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:32.928589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-bf344add-be99-44fc-8650-72daacd563b4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494618 May 12 17:44:32.929210 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 106/201] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:44:32 2022] POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:33.057175 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:33.057901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:33.058062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:33.064706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:33.065157 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:33.065941 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:33.066391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:33.066742 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-fb4e9dc0-f4c2-4d8e-8bd5-0527c44976c0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.175144 May 12 17:44:33.067432 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 96/202] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:32 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:33.079925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:33.080679 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:33.088670 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:33.089249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:33.090163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:33.090699 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:33.213776 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:33.221069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4d4a2c22-e8e1-4356-bc6c-c1b6611a240d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.168801 May 12 17:44:33.221645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 107/203] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:33 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:33.226284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:33.233722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-66f34c4c-bf25-478c-9e0b-7af77875f390 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1507 microversion: 2.1 time: 0.157675 May 12 17:44:33.234453 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 97/204] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:33 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:33.236795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:33.237644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:33.244901 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:33.245366 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:33.246154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:33.246596 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:33.402385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:33.415742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:33.417397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:33.418631 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8460f8e1-2e11-4796-b142-984f7f7e4738 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.185957 May 12 17:44:33.419422 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 108/205] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:33 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:34.084595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:34.085223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:34.093848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:34.094304 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:34.095118 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:34.095559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:34.238304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:34.239583 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:34.241713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:34.249162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:34.249784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:34.250275 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-69e8a113-8e5e-40a4-8081-ef39c1645ccb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.169723 May 12 17:44:34.250974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:34.251225 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 98/206] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:34 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:34.251423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:34.381908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:34.390253 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4c62c959-e7e7-40b3-984a-4362f0f9cda2 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.156324 May 12 17:44:34.391010 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 109/207] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:34 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:34.436796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:34.437405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:34.443363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:34.443816 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:34.444585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:34.445022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:34.530391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1fcbc9e8-f531-42ed-92c6-159529c7481f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: .version_select at 0x7f24bcedb790>, body: {"keypair": {"name": "tempest-keypair-9759578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8ASV5nGuq8f662YQN5TZHe8PI9akkqueS2OjVH0fSxIij4nAFSlkq/RnGH2Q0RRGbx+ro8VEBdZ9fDraCy8MJ/sZo1tMs+R4wJ3ObfkPoVTJYVE50FrMXNIM82JtdGFQ=="}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:34.544483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-1fcbc9e8-f531-42ed-92c6-159529c7481f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:44:34.548331 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-1fcbc9e8-f531-42ed-92c6-159529c7481f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:44:34.574275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1fcbc9e8-f531-42ed-92c6-159529c7481f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.047611 May 12 17:44:34.575147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 110/208] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:44:34 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:44:34.585704 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:34.594404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:34.596017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:34.597184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-749a65d1-945a-4309-8fb0-cede95f9df48 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.164340 May 12 17:44:34.598048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 99/209] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:34 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:35.110273 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-d2541b19-4bd0-4576-9866-4eaa0f7b5689 req-2c1e1435-de8a-4f4a-bd55-f3e5e16f7edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b227b1-c2a6-43c9-83dc-b056690fb302", "name": "network-vif-plugged", "status": "completed", "tag": "2a43a5b7-d5f3-49fe-b099-b75fafbd237a"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:35.121954 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d2541b19-4bd0-4576-9866-4eaa0f7b5689 req-2c1e1435-de8a-4f4a-bd55-f3e5e16f7edf service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:35.122477 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d2541b19-4bd0-4576-9866-4eaa0f7b5689 req-2c1e1435-de8a-4f4a-bd55-f3e5e16f7edf service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:35.133937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-d2541b19-4bd0-4576-9866-4eaa0f7b5689 req-2c1e1435-de8a-4f4a-bd55-f3e5e16f7edf service nova] Creating event network-vif-plugged:2a43a5b7-d5f3-49fe-b099-b75fafbd237a for instance 85b227b1-c2a6-43c9-83dc-b056690fb302 on hv-cinder-83979 May 12 17:44:35.138788 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-d2541b19-4bd0-4576-9866-4eaa0f7b5689 req-2c1e1435-de8a-4f4a-bd55-f3e5e16f7edf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032196 May 12 17:44:35.139871 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 111/210] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:35.267249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:35.268258 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:35.275004 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:35.275462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:35.276249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:35.276691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:35.409783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:35.411279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:35.417200 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:35.419291 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:35.419924 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:35.421310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:35.421912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:35.426796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-dfa7a30c-3faf-4af6-9050-23883691fc8d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.163294 May 12 17:44:35.436743 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 100/211] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:35 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:35.620876 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:35.621713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:35.633703 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:35.634655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:35.636170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:35.637645 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:35.649433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:35.657507 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d349f150-1f08-422b-bf03-4f341a2c3401 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.251954 May 12 17:44:35.669791 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 112/212] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:35 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:35.861907 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:35.886434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:35.889218 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:35.890829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-53842967-f580-46d5-9e9b-fc365549505c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.275290 May 12 17:44:35.891873 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 101/213] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:35 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:36.443413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:36.444008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:36.449065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-438203755", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f0e5ba6-f1dc-4741-a091-633af3cfbec5"}], "security_groups": [{"name": "tempest-securitygroup--536991895"}], "key_name": "tempest-keypair-9759578", "user_data": "}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:36.452022 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.452566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.453346 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.453778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.554323 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] validate_networks() for [('5f0e5ba6-f1dc-4741-a091-633af3cfbec5', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:44:36.588319 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:36.595826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-610fa6cb-5f18-4ce1-bd57-8493f0c5f80d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.156084 May 12 17:44:36.596388 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 113/214] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:36 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:36.673275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:36.673885 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:36.680718 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.681328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.681970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.682410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.814460 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:36.822067 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-019eea5d-851c-4083-981f-855476b40f37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.152596 May 12 17:44:36.822772 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 114/215] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:36 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:36.909297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:36.910066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:36.916716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.917169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.917980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.918415 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.933976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:44:36.934438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:44:36.934955 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:44:36.935365 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:44:36.935783 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:44:36.944915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.945634 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.946497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:36.947155 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:36.965613 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:44:36.969756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:44:36.983239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:44:36.987867 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:44:37.038302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c0e1d7df-2134-4e68-89f7-0068bd95539c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594412 May 12 17:44:37.044362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 102/216] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:44:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:44:37.051238 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-45d2835a-adc0-4480-ba73-920708c838a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:37.051958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-45d2835a-adc0-4480-ba73-920708c838a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:37.080626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:37.088800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:37.090589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:37.091798 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e63a2112-05a4-4bd3-a4e4-5856f0e730ee tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.186450 May 12 17:44:37.092355 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 115/217] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:36 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:37.115142 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-45d2835a-adc0-4480-ba73-920708c838a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:37.122918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-45d2835a-adc0-4480-ba73-920708c838a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1238 microversion: 2.1 time: 0.077613 May 12 17:44:37.123470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 103/218] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:37 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:37.613352 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:37.613886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:37.620872 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:37.621318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:37.622086 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:37.622553 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:37.751222 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:37.759313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-44b23e88-b63b-46cf-a5e2-cbe889658245 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1519 microversion: 2.1 time: 0.149898 May 12 17:44:37.760002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 116/219] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:37 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:37.839657 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:37.840551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:37.847462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:37.847997 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:37.849082 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:37.849608 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:37.985272 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:37.993160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-bd23c533-d7f3-4375-a2cf-1194d397f190 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.157803 May 12 17:44:37.993813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 104/220] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:37 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:38.109355 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:38.109955 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:38.115861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.116314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:38.117079 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.118271 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:38.139881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:38.140554 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:38.146800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.147209 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:38.148034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.148478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:38.209484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:38.217235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1bed9d7e-4373-47f3-b56b-8a75e41ffe28 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1242 microversion: 2.1 time: 0.081208 May 12 17:44:38.225404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 105/221] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:38 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:38.247346 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:38.255504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:38.256996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:38.259194 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fa06d6dd-d7fe-42fa-9591-f7f489483977 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.153342 May 12 17:44:38.259393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 117/222] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:38 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:38.777376 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:38.777980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:38.783992 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.784441 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:38.785202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.785644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:38.918446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:38.925883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4da99f01-e685-45fb-bae5-1264cdddb3c3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1499 microversion: 2.1 time: 0.152377 May 12 17:44:38.926453 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 106/223] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:38 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:38.942381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:38.943034 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:38.949906 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.950354 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:38.951226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:38.951671 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:39.009364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:39.009976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:39.015904 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:39.016357 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:39.017130 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:39.017838 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:39.085333 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:39.093672 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4ad2c51a-9e12-438c-8da5-c401b129ceeb tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1514 microversion: 2.1 time: 0.155089 May 12 17:44:39.094252 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 118/224] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:38 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:39.157075 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:39.166290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5ee90378-6f54-467e-ba33-988bdf26e08f tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1313 microversion: 2.1 time: 0.160882 May 12 17:44:39.167564 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 107/225] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:39 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:39.234101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:39.234753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:39.241695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:39.241695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:39.242811 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:39.243324 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:39.281597 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:39.282300 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:39.301741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:39.302440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:39.303593 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:39.304411 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:39.324463 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:39.335730 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7d0a0321-8ebc-40f8-88c5-7441b12f1e9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1242 microversion: 2.1 time: 0.105145 May 12 17:44:39.337721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 119/226] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:39 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:39.472954 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:39.489888 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:39.491520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:39.492823 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1d0d2c18-803d-4de4-9ec0-4989fcbc4e85 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.217103 May 12 17:44:39.493418 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 108/227] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:39 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:40.185422 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:40.186026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:40.192356 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.192857 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.193626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.194065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.322053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:40.329407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3eb15cbb-36da-46da-812c-7c00173aab1b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1497 microversion: 2.1 time: 0.147918 May 12 17:44:40.329975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 120/228] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:40 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:40.353405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:40.354307 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:40.364771 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.365546 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.366891 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.367565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.434338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:40.441644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b572800f-ba06-4a9a-a6dd-d5e9fdd68d4f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1242 microversion: 2.1 time: 0.092174 May 12 17:44:40.442216 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 109/229] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:40 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:40.511805 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:40.512414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:40.514059 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:40.515294 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:40.521763 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.522270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.524088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.524800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.526088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.526544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.527365 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.527926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.562611 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lazy-loading 'flavor' on Instance uuid f9fe1954-0d79-4a7b-a18f-463a1e44b42a {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:44:40.637147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-93933209-907d-4343-aabc-9e752ec9924d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a/action" status: 200 len: 32 microversion: 2.1 time: 0.127114 May 12 17:44:40.637934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 110/230] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:44:40 2022] POST /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 17:44:40.647293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:40.648180 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:40.655579 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.656960 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.658814 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:40.659260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:40.668046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:40.677950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:40.679500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:40.680858 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9ffe17f5-d593-405a-8ff5-0fd5e4e30b68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.173460 May 12 17:44:40.681423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 121/231] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:40 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:40.804424 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:40.812807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8cd08aa8-1905-40a2-aa20-b068a540c726 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.169368 May 12 17:44:40.813689 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 111/232] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:40 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:41.220595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:41.221102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:41.227740 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.228308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.229100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.229550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.259159 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:44:41.339890 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9daa346a-1537-43b0-bed8-c29ecf149eef tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "DELETE /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 204 len: 0 microversion: 2.1 time: 0.122848 May 12 17:44:41.340587 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 122/233] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:44:41 2022] DELETE /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:44:41.348589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:41.349194 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:41.355554 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.356183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.356765 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.357204 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.459501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:41.460191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:41.466483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.466958 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.467719 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.468147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.495824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:41.503207 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2bfe96e4-9443-4de1-afcd-2ecaa7653b37 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1503 microversion: 2.1 time: 0.158375 May 12 17:44:41.503781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 112/234] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:41 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:41.532572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:41.540232 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-15ea80cf-b52c-438c-8d3a-10912d1dc6f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1234 microversion: 2.1 time: 0.084904 May 12 17:44:41.540800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 123/235] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:41 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:41.700031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:41.700644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:41.707210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.707734 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.708587 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.709176 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.829968 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:41.831016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:41.837797 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.838692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.839479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:41.840081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:41.841092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:41.850100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:41.852162 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:41.853558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-883c5465-a230-4008-bd0e-5a8f09ba6dea tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.158209 May 12 17:44:41.854122 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 113/236] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:41 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:41.967810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:41.975021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6d17ad35-f255-4b01-9403-ce85f38ba7c7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.149071 May 12 17:44:41.975588 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 124/237] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:41 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:42.521612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:42.522230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:42.529683 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:42.530138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:42.530949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:42.531391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:42.557178 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:42.557791 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:42.564126 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:42.564589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:42.565361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:42.565802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:42.638007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:42.646081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5e9ce564-727e-41cf-96bb-9e9570d1d854 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1290 microversion: 2.1 time: 0.092700 May 12 17:44:42.647056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 125/238] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:42 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:42.666386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:42.674374 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-495c2532-f414-4285-92f0-4da0e40b6843 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1503 microversion: 2.1 time: 0.157012 May 12 17:44:42.674963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 114/239] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:42 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:42.872595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:42.873191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:42.879081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:42.879525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:42.880279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:42.880709 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:42.992851 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:42.993697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:43.000089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:43.000540 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:43.001342 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:43.001786 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:43.012129 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:43.020113 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:43.021609 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:43.022774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ea19682f-74cb-4833-8da0-2aaba0a989e8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.154047 May 12 17:44:43.023337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 126/240] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:42 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:43.138697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:43.146265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b0965454-d6bb-44ee-b127-74748e6efe0d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.157880 May 12 17:44:43.147211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 115/241] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:42 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:43.663500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:43.664120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:43.671167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:43.671696 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:43.672464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:43.672894 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:43.691736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:43.693655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:43.701233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:43.701764 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:43.702610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:43.703139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:43.740559 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:43.754399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-49fd387c-b904-4844-bb75-343d58c7c5fa tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1290 microversion: 2.1 time: 0.094611 May 12 17:44:43.755215 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 127/242] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:43 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:43.846110 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:43.853825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9a6d76b6-e55b-4331-8186-4063e2998000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1503 microversion: 2.1 time: 0.166488 May 12 17:44:43.854425 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 116/243] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:43 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:43.893069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-467101856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235511178", "security_groups": [{"name": "tempest-secgroup-smoke-1268337681"}], "block_device_mapping_v2": [{"uuid": "abe30758-795c-4b5b-aa34-27248b9f75f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb76e15-efb3-4276-8531-f3adac3a6ec1"}]}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:44.010082 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] validate_networks() for [('3cb76e15-efb3-4276-8531-f3adac3a6ec1', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:44:44.041082 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:44.041781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:44.047859 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.048401 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.049177 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.049614 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.182578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:44.190561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:44.192110 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:44.193648 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-61f743f9-b9b2-447a-abec-87e78b704925 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.156271 May 12 17:44:44.196195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 117/244] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:44 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:44.199699 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:44.200297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:44.206631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.207205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.208018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.208457 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.344600 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:44.352114 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b30300d4-6166-4ae2-ab9c-bcadee0d1951 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.156621 May 12 17:44:44.352686 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 118/245] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:44 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:44.398079 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:44:44.398571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:44:44.399069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:44:44.399467 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:44:44.399875 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:44:44.408430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.408874 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.409674 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.410112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.426059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:44:44.430962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for user 7802c329d4ca4eccb28fdec9f8082cc1 and project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:44:44.494765 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:44:44.496840 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abe30758-795c-4b5b-aa34-27248b9f75f6',volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:44:44.622750 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e273d22b-7e5d-435a-99df-ef970b539ced tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733763 May 12 17:44:44.632045 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 128/246] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:44:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:44:44.654572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-15989d6d-bcca-4486-8ce9-afe0bdee9f2b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:44.655370 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-15989d6d-bcca-4486-8ce9-afe0bdee9f2b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:44.734957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-15989d6d-bcca-4486-8ce9-afe0bdee9f2b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:44.742762 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-15989d6d-bcca-4486-8ce9-afe0bdee9f2b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1093 microversion: 2.1 time: 0.091483 May 12 17:44:44.743817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 119/247] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:44 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1093 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:44.773591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:44.774381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:44.781190 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.781642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.782409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.782880 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.848898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:44.858881 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3eff0c58-d23e-4cd9-8fd6-40c935d7a8e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1290 microversion: 2.1 time: 0.089472 May 12 17:44:44.859469 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 129/248] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:44 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:44.871152 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:44.871763 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:44.878604 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.879078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:44.879852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:44.880289 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.022890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:45.030715 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-132358c1-6aa0-4efa-aec2-ef589d502dde tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1503 microversion: 2.1 time: 0.163939 May 12 17:44:45.031276 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 120/249] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:44 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:45.219465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:45.219951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:45.226566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.227416 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.228767 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.229577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.362868 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:45.372222 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:45.372753 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:45.373345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:45.373746 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:45.375182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7b243998-580a-44eb-86c4-08f6525403a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.159781 May 12 17:44:45.375744 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 130/250] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:45 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:45.379483 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.379932 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.380702 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.381158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.510933 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:45.518476 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0ffcf98b-8662-4a27-a6b9-0dc4211cfd33 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.149823 May 12 17:44:45.519084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 121/251] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:45 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:45.761807 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:45.762869 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:45.773597 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.775047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.778278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.778893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.875498 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:45.876322 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:45.889931 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.890482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.891368 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:45.892032 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:45.949061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:45.958788 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-bda94617-618a-43c3-9700-c3eef53cc54e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1135 microversion: 2.1 time: 0.202537 May 12 17:44:45.959974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 131/252] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:45 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1135 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:45.989437 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:45.998956 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-21db8a7d-6b0c-42b1-8831-0c37fe13d9b7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1296 microversion: 2.1 time: 0.127168 May 12 17:44:45.999548 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 122/253] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:45 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:46.048502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:46.049106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:46.055075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.055624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.056585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.057018 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.188781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:46.196590 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9d7d1870-2b3d-4a95-b1cc-4a8c4d02f3c7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1503 microversion: 2.1 time: 0.151755 May 12 17:44:46.197159 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 132/254] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:46 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:46.396389 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:46.397289 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:46.404313 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.405039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.406062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.406708 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.443098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-f29e7a39-ec18-4f91-8dcc-24d5d3e3784c req-aa9be575-2980-44f8-9da4-550373296110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b227b1-c2a6-43c9-83dc-b056690fb302", "name": "network-vif-deleted", "tag": "2a43a5b7-d5f3-49fe-b099-b75fafbd237a"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:46.453662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-f29e7a39-ec18-4f91-8dcc-24d5d3e3784c req-aa9be575-2980-44f8-9da4-550373296110 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.454839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-f29e7a39-ec18-4f91-8dcc-24d5d3e3784c req-aa9be575-2980-44f8-9da4-550373296110 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.470150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-f29e7a39-ec18-4f91-8dcc-24d5d3e3784c req-aa9be575-2980-44f8-9da4-550373296110 service nova] Creating event network-vif-deleted:2a43a5b7-d5f3-49fe-b099-b75fafbd237a for instance 85b227b1-c2a6-43c9-83dc-b056690fb302 on hv-cinder-83979 May 12 17:44:46.478080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-f29e7a39-ec18-4f91-8dcc-24d5d3e3784c req-aa9be575-2980-44f8-9da4-550373296110 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039766 May 12 17:44:46.479415 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 133/255] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:46.537605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:46.538517 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:46.545472 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.546295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.547597 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.548390 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.564821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:46.573269 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:46.574811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:46.576316 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b73f0055-9f0f-4276-bf91-21e18ebc0971 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.186862 May 12 17:44:46.577159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 123/256] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:46 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:46.791134 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:46.818166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d224040b-8da9-4587-b789-c5850a0da967 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.285293 May 12 17:44:46.821083 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 134/257] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:46 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:46.916444 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5e7ad44b-6ea3-4030-aee1-9df292c2a9ea tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:46.924835 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e7ad44b-6ea3-4030-aee1-9df292c2a9ea tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.925534 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e7ad44b-6ea3-4030-aee1-9df292c2a9ea tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:46.986753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:46.987390 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:46.997824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:46.998277 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.001145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.001595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.014696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5e7ad44b-6ea3-4030-aee1-9df292c2a9ea tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Going to try to stop instance {{(pid=123688) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 17:44:47.074515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5e7ad44b-6ea3-4030-aee1-9df292c2a9ea tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.162227 May 12 17:44:47.075599 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 124/258] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:44:46 2022] POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:44:47.083720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:47.084601 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:47.090934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:47.091111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.091566 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.092482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.092918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.098501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5013560d-da0e-4cac-8eaa-cb162e35e75b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1209 microversion: 2.1 time: 0.119108 May 12 17:44:47.099187 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 135/259] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:46 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:47.105404 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:47.106195 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:47.114163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.114993 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.115804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.116249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.257519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:47.267048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a679740e-4c0b-4334-aa3e-817d85d2a964 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.187190 May 12 17:44:47.267886 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 125/260] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:47 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:47.277920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:47.278627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:47.285624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.286350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.287448 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.288115 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.325282 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.325842 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.326355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 85b227b1-c2a6-43c9-83dc-b056690fb302 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:44:47.341782 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:47.350192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-04518f9b-5dfa-41c6-a54f-8e01755a1d73 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.249574 May 12 17:44:47.357326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 136/261] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:47 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:47.377177 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:47.385763 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5db61cde-8b1a-4687-b7a8-e10d0b2f11ca tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 200 len: 1303 microversion: 2.1 time: 0.116624 May 12 17:44:47.386699 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 126/262] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:47 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:47.595488 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:47.596347 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:47.606033 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.606882 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.607837 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.608412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.836719 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:47.837326 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:47.847150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:47.847696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.848037 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.848806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:47.851263 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:47.855559 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:47.857084 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:47.858249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-51bb3737-d77c-46a0-b494-3dc3d97ac413 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.266770 May 12 17:44:47.870181 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 137/263] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:47 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:48.070009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:48.078257 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a112c19f-ef72-4e80-a628-9e9445b9abb5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.245512 May 12 17:44:48.099482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 127/264] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:47 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:48.117063 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:48.118076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:48.126964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.128339 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.129413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.129999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.284897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:48.285770 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:48.314269 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.314624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.316345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.316345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.378894 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:48.389718 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-30830b0b-12dc-495b-9663-a994e819a0f7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.276685 May 12 17:44:48.390313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 138/265] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:48 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:48.401263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:48.402055 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:48.410461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.415188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.416542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.417154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.595042 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:48.603414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4dc89693-6b88-45d0-9d08-f688ceecaa31 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.322297 May 12 17:44:48.607899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 128/266] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:48 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:48.615864 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:48.616476 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 85b227b1-c2a6-43c9-83dc-b056690fb302] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:48.625938 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.626313 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.627128 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.631150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.653297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] HTTP exception thrown: Instance 85b227b1-c2a6-43c9-83dc-b056690fb302 could not be found. May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Request method failure captured: May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 HTTP/1.1 May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUd3j0v2qdkD_eKw98_ut3UfgJdYfLx6EHnEa8obBC8HTEPzD9-L3lQjsa3Thp0SYmdIRnjWMj9jmGgU953BfOoCN9JFjT7XjVdKoN9jg_lN5taFTpJlYnsrK77x4s0_PdnBVSovPnt_Vclf2jqBdWLVApN7ZsGXIOTy6tydZ8H33mI May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 75736e80e44a481484d88e394c5269d6 May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-VolumesActionsTest-1686172247 May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:44:48.655466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75736e80e44a481484d88e394c5269d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_75736e80e44a481484d88e394c5269d6", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/75736e80e44a481484d88e394c5269d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75736e80e44a481484d88e394c5269d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-VolumesActionsTest-1686172247 May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 75736e80e44a481484d88e394c5269d6 May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-VolumesActionsTest-1686172247 May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-VolumesActionsTest-1686172247-project May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 967a537eb434465e8294c324a83ef5b0 May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-VolumesActionsTest-1686172247-project May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 85b227b1-c2a6-43c9-83dc-b056690fb302 could not be found. May 12 17:44:48.656998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '85b227b1-c2a6-43c9-83dc-b056690fb302'} May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b227b1-c2a6-43c9-83dc-b056690fb302 could not be found. May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:44:48.657949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b227b1-c2a6-43c9-83dc-b056690fb302 could not be found. May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b227b1-c2a6-43c9-83dc-b056690fb302 could not be found. May 12 17:44:48.659431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:44:48.661534 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Returning 404 to user: Instance 85b227b1-c2a6-43c9-83dc-b056690fb302 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:44:48.662540 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-75f12c76-53a7-402b-9d87-54c820be6024 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302" status: 404 len: 111 microversion: 2.1 time: 0.053679 May 12 17:44:48.663814 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 129/267] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:48 2022] GET /compute/v2.1/servers/85b227b1-c2a6-43c9-83dc-b056690fb302 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:44:48.670407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-a2c6a95b-720f-4b8d-a685-7cd105639c53 req-d0a1e208-b8c8-41c9-8e9b-97ad81f5dacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a5023a-5da1-4a91-a0ad-0775ff136725", "tag": "26a87193-d1d2-4c6e-ba24-c895c9893c18"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:48.688362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a2c6a95b-720f-4b8d-a685-7cd105639c53 req-d0a1e208-b8c8-41c9-8e9b-97ad81f5dacc service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.688836 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a2c6a95b-720f-4b8d-a685-7cd105639c53 req-d0a1e208-b8c8-41c9-8e9b-97ad81f5dacc service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.706269 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-a2c6a95b-720f-4b8d-a685-7cd105639c53 req-d0a1e208-b8c8-41c9-8e9b-97ad81f5dacc service nova] Creating event network-changed:26a87193-d1d2-4c6e-ba24-c895c9893c18 for instance 05a5023a-5da1-4a91-a0ad-0775ff136725 on hv-cinder-83979 May 12 17:44:48.715111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-a2c6a95b-720f-4b8d-a685-7cd105639c53 req-d0a1e208-b8c8-41c9-8e9b-97ad81f5dacc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048261 May 12 17:44:48.716706 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 130/268] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:48.718901 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:48.731960 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-14f51f7b-ef8c-497e-b0ca-23f7599d48b0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.336468 May 12 17:44:48.739406 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 139/269] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:48 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:48.746871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-390735240", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "networks": [{"uuid": "72ed361c-ef6b-4562-85b5-0e16d11b9029"}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:48.808713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] validate_networks() for [('72ed361c-ef6b-4562-85b5-0e16d11b9029', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:44:48.878012 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:48.878689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:48.886373 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.887007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:48.888295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:48.888796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.097732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:49.106162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:49.107904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:49.109294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e1e5c6de-15c1-4bf5-b878-dda622533d61 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.236228 May 12 17:44:49.123084 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 140/270] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:48 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:49.128736 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:49.129475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:49.136922 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.137371 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.138288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.138592 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.280899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:49.295821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-41099671-2b0f-4efe-aaab-a6e425b6b7c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.171524 May 12 17:44:49.296580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 141/271] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:49 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:49.410270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:49.411401 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:49.423662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.424189 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.425226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.425657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.581535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:49.589913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-57c06f89-c522-4a5b-a5bc-777b83786a8c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.184438 May 12 17:44:49.599463 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 142/272] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:49 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:49.624197 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:49.624803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:49.630646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.631182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.631901 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.632337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.634989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:44:49.635501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:44:49.636074 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:44:49.636644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:44:49.637060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:44:49.647433 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.647883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.648911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.649460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.666943 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Getting quotas for project 75736e80e44a481484d88e394c5269d6. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:44:49.670921 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Getting quotas for user 967a537eb434465e8294c324a83ef5b0 and project 75736e80e44a481484d88e394c5269d6. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:44:49.687102 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:44:49.689677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:44:49.750514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ffe8e088-0b76-4d9a-a99a-5e49d05c2cbc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009103 May 12 17:44:49.757466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 131/273] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:44:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:44:49.766751 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-774bf5cf-3ba4-4179-b63b-0937764fe487 req-c48ba12f-e40f-4a26-aa8d-231bacc9da7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a1ff6d-1105-476b-880e-39e5d783b0a2", "tag": "aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:49.784680 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-774bf5cf-3ba4-4179-b63b-0937764fe487 req-c48ba12f-e40f-4a26-aa8d-231bacc9da7b service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.785140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-774bf5cf-3ba4-4179-b63b-0937764fe487 req-c48ba12f-e40f-4a26-aa8d-231bacc9da7b service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.797781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:49.803247 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-774bf5cf-3ba4-4179-b63b-0937764fe487 req-c48ba12f-e40f-4a26-aa8d-231bacc9da7b service nova] Creating event network-changed:aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4 for instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 on hv-cinder-83979 May 12 17:44:49.807503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-550715b7-2c14-436b-a4f4-f7b9e6026501 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.187154 May 12 17:44:49.809031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 143/274] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:49 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:49.809966 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-774bf5cf-3ba4-4179-b63b-0937764fe487 req-c48ba12f-e40f-4a26-aa8d-231bacc9da7b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053771 May 12 17:44:49.810550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 132/275] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:49.815972 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1536c9f8-a8d5-46d2-a21e-c41501d26ec0 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:49.816659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1536c9f8-a8d5-46d2-a21e-c41501d26ec0 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:49.818504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:49.819211 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:49.826072 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.826518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.827334 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:49.827764 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:49.884233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1536c9f8-a8d5-46d2-a21e-c41501d26ec0 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:49.891901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1536c9f8-a8d5-46d2-a21e-c41501d26ec0 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1213 microversion: 2.1 time: 0.079996 May 12 17:44:49.893028 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 133/276] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:49 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:49.995607 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.003509 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b17a8775-dd3b-4201-b6b0-3e2597cc85db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.188930 May 12 17:44:50.004269 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 144/277] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:49 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:50.128957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:50.129692 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:50.138961 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.139358 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.140138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.140579 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.275285 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.282996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.284535 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.285690 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ea2e2c1b-a14b-4d52-beb4-e4f8fc0ef968 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.161132 May 12 17:44:50.286240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 134/278] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:50 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:50.313193 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:50.313801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:50.319691 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.320686 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.321463 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.321899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.452465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.459841 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1556b4ce-18a7-4167-8cb8-91fbaa1c9bba tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.150512 May 12 17:44:50.460444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 145/279] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:50 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:50.606462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:50.607136 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:50.613202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.613653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.614419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.614886 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.753616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.761282 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f315dd41-dbe0-45d7-a1a2-ec41d9d04c37 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.158501 May 12 17:44:50.761710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 135/280] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:50 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:50.825701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:50.826932 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:50.833147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.833692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.834530 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.835061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.909471 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:50.910030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:50.916738 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.917227 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.918248 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:50.918952 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:50.964717 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.971921 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-12564ac4-5f96-4766-87b3-2e8ab1b4400a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.150298 May 12 17:44:50.972493 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 146/281] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:50 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:50.982303 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:50.989549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0a34766c-b7e7-4eca-acb0-8bb30d9b5fda tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1217 microversion: 2.1 time: 0.084111 May 12 17:44:50.990120 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 136/282] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:50 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:51.021737 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:51.022468 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:51.029353 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.029955 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.030695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.031169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.196956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:51.204636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1b2f539a-9907-40f2-b24a-e81c1a5f7f1c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.187377 May 12 17:44:51.205195 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 147/283] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:51 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:51.303475 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:51.304071 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:51.311059 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.311505 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.312265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.312693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.479060 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:51.479591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:51.487146 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.487874 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.489002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.489600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.553324 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:51.562371 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:51.563936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:51.565118 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-df0dbfe7-934c-4e71-b413-3e660f8cb8a9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.265534 May 12 17:44:51.566018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 137/284] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:51 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:51.779389 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:51.780150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:51.786199 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.786777 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.787630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.788138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:51.805966 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:51.813288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5bf8e1f1-3d8c-421a-acfc-da867bdd7f3b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.339816 May 12 17:44:51.813776 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 148/285] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:51 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:51.919645 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:51.927444 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e285d57a-cea2-484e-9101-600a9f6b5c28 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.151876 May 12 17:44:51.928013 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 138/286] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:51 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:51.989708 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:51.990801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:51.999151 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:51.999860 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.002603 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.003930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.006824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:52.007667 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:52.015370 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.016359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.017307 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.018164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.140541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:52.150464 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-81f2bade-8113-4c93-ae26-402f12e71ed7 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1265 microversion: 2.1 time: 0.147402 May 12 17:44:52.160746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 139/287] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:52 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:52.222448 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:52.223164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:52.233646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.234451 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.235475 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.236132 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.278922 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:52.286885 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-452f32dd-6554-4e4d-b3e7-75c21152bee9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.301094 May 12 17:44:52.287451 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 149/288] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:51 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:52.455653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:52.464191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-615ac23d-58c6-4f6d-b543-dc0cdb418660 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.245888 May 12 17:44:52.464870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 140/289] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:52 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:52.584067 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:52.584749 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:52.591681 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.592134 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.592951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.593383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.751507 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:52.760428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:52.762382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:52.763705 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-61a3ad55-03ca-44f0-9a7c-2c6cfc557124 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1746 microversion: 2.20 time: 0.183821 May 12 17:44:52.764629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 150/290] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:52 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:52.833424 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:52.835006 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:52.859162 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.859772 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.860675 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.863057 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.944268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:52.945249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:52.951938 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.952601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:52.953545 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:52.954140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.093176 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.100631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-01069601-eab3-433a-9d02-3634c368938a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.271697 May 12 17:44:53.101449 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 141/291] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:52 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:53.128852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.137513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-05976961-6df7-4b59-bc35-fbc0edf89163 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.197041 May 12 17:44:53.138525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 151/292] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:52 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:53.168493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:53.169413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:53.177172 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.177933 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.178903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.179527 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.304310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:53.305485 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:53.312114 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.312626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.313506 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.314049 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.411013 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.422139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-32520dc1-3623-4064-97a8-5a4a20b0b201 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.258365 May 12 17:44:53.422719 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 142/293] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:53 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:53.469832 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.478925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c1ca7a5f-7f87-4135-a2cb-d4b7c06e4ff8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.178336 May 12 17:44:53.479504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 152/294] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:53 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:53.482525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:53.483241 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:53.489137 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.489554 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.490470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.490883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.700226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.708833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c9884085-d897-4b58-bb89-86b5c082629f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.230845 May 12 17:44:53.709414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 143/295] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:53 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:53.784092 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:53.784704 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:53.794810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.795400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.796812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.797256 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.840555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-ad93916d-630c-435c-86ae-7bc81190eafc req-aa23c822-cf86-4d3d-978e-5181d5d458f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176f48af-5412-4ccb-99e0-1431c7fce694", "tag": "50c3310e-fb35-4a1e-b702-1e8dd20ff13a"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:53.850495 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-ad93916d-630c-435c-86ae-7bc81190eafc req-aa23c822-cf86-4d3d-978e-5181d5d458f6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:53.850973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-ad93916d-630c-435c-86ae-7bc81190eafc req-aa23c822-cf86-4d3d-978e-5181d5d458f6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:53.876672 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-ad93916d-630c-435c-86ae-7bc81190eafc req-aa23c822-cf86-4d3d-978e-5181d5d458f6 service nova] Creating event network-changed:50c3310e-fb35-4a1e-b702-1e8dd20ff13a for instance 176f48af-5412-4ccb-99e0-1431c7fce694 on hv-cinder-83979 May 12 17:44:53.884073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-ad93916d-630c-435c-86ae-7bc81190eafc req-aa23c822-cf86-4d3d-978e-5181d5d458f6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049107 May 12 17:44:53.884688 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 144/296] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:53.942615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.951038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.952534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:53.953671 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1262178b-4e3e-448d-af9d-b099913d35f0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1746 microversion: 2.20 time: 0.173838 May 12 17:44:53.954222 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 153/297] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:53 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:54.117777 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:54.118472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:54.125023 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.125481 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.126256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.126711 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.156184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:54.157097 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:54.164550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.165059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.165883 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.166322 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.316348 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:54.325843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:54.333571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-36826b2c-a82f-4d6b-a97f-33e17e18d0d8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.181780 May 12 17:44:54.336413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-773d26e6-2cd6-479f-bcb5-4c5ae3bb1e72 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.222202 May 12 17:44:54.348225 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 154/298] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:54 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:54.348624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 145/299] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:54 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:54.438182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:54.438825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:54.444614 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.445103 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.445956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.446394 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.495617 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:54.496339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:54.502236 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.502772 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.503541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.503974 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.577150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:54.584759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-23c47693-cfa2-45e0-a6cd-efda21ae9a31 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.150465 May 12 17:44:54.585329 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 155/300] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:54 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:54.631830 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:54.639388 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-16a3881f-a2ef-42dd-a3be-dbd3a0c2d9c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.147646 May 12 17:44:54.639962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 146/301] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:54 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:54.726036 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:54.727467 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:54.733238 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.733688 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.734450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.734912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.867484 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:54.876366 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9208e0fd-6782-417d-b8bf-816162cd8cbb tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.154168 May 12 17:44:54.876930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 156/302] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:54 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:54.972548 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:54.973076 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:54.980250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.980694 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:54.981451 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:54.981883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.111661 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:55.119380 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:55.120886 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:55.122035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4ada7a70-7f17-4a13-9faf-68c9a3baab53 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1746 microversion: 2.20 time: 0.153505 May 12 17:44:55.122589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 147/303] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:54 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:55.353474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:55.354081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:55.360604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.361089 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.361824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.362260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.366144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:55.366803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:55.373145 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.373620 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.374396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.374862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.496680 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:55.503919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-50d034e6-5150-44e3-ba5c-21e968a3f8b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.154515 May 12 17:44:55.504518 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:55.505408 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 157/304] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:55 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:55.512942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f8606f80-31bc-4294-8a92-e8de21533301 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.150576 May 12 17:44:55.513492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 148/305] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:55 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:55.601052 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:55.601706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:55.607538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.607983 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.608742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.609176 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.656180 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:55.656784 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:55.662610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.663089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.663989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.664701 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.737228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:55.745606 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-844874ef-18c3-44e9-a364-44a58bea66cd tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.148207 May 12 17:44:55.746090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 158/306] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:55 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:55.795274 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:55.802693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-38911b9c-cbcc-477d-90fb-f813ebff96ea tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.150289 May 12 17:44:55.803272 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 149/307] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:55 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:55.893320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:55.893946 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:55.899821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.900268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:55.901030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:55.901466 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.029183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.037843 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-32bc88ad-e446-4fad-9727-7ff5fc7f9566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.148525 May 12 17:44:56.038704 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 159/308] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:55 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:56.127897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-a10ca8e7-2055-407d-8ab6-3d5908a281ea req-42a85b13-d99e-4575-b91d-1f4665d03f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a5023a-5da1-4a91-a0ad-0775ff136725", "name": "network-vif-plugged", "status": "completed", "tag": "26a87193-d1d2-4c6e-ba24-c895c9893c18"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:56.138494 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a10ca8e7-2055-407d-8ab6-3d5908a281ea req-42a85b13-d99e-4575-b91d-1f4665d03f73 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.139141 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a10ca8e7-2055-407d-8ab6-3d5908a281ea req-42a85b13-d99e-4575-b91d-1f4665d03f73 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.140286 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:56.140969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:56.147399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.147920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.148922 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.149450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.160627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-a10ca8e7-2055-407d-8ab6-3d5908a281ea req-42a85b13-d99e-4575-b91d-1f4665d03f73 service nova] Creating event network-vif-plugged:26a87193-d1d2-4c6e-ba24-c895c9893c18 for instance 05a5023a-5da1-4a91-a0ad-0775ff136725 on hv-cinder-83979 May 12 17:44:56.168643 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-a10ca8e7-2055-407d-8ab6-3d5908a281ea req-42a85b13-d99e-4575-b91d-1f4665d03f73 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044588 May 12 17:44:56.169388 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 150/309] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:56.286024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.294763 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.296285 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.297466 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-47dd1f21-50bc-4f8d-ba8a-29163974e5a6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1746 microversion: 2.20 time: 0.161150 May 12 17:44:56.298019 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 160/310] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:56 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:44:56.522548 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:56.523440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:56.529311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:56.529953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.530060 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:56.530399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.531196 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.531628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.536644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.537157 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.537947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.538391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.672532 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.680526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0e9d284d-1c8a-4d3b-8456-ceae6e0e724e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.154769 May 12 17:44:56.681292 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 161/311] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:56 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:56.705935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.715416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-336bc4e7-28eb-4831-a4dd-b27bea3c367c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.197768 May 12 17:44:56.725191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 151/312] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:56 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:56.762998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:56.763668 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:56.771122 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.771596 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.772443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.772856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.820549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:56.821158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:56.827363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.827812 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.828585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:56.829020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:56.906002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.913390 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c6de5439-a38d-4d6b-ba06-cc842d7eeeac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.154478 May 12 17:44:56.914806 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 162/313] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:56 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:56.961369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:56.968630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-53631255-fd3f-4c81-b62c-9749d222ff5f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.151946 May 12 17:44:56.969200 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 152/314] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:56 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:57.056513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.057051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:57.062955 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.063409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.064175 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.064610 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.196723 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:57.205270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3614d49b-7f42-49ed-ae29-d4d2bee49bf5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.153396 May 12 17:44:57.206028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 163/315] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:57 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:57.314603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.315257 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:57.321815 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.322262 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.323298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.323796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.516532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:57.525581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:57.527141 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:57.528309 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-57e414fe-b3bc-4cb9-aad3-353925c1332b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.217651 May 12 17:44:57.529235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 153/316] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:57 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:57.698001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.698694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:57.715428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.715975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.716846 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.717359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.733308 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.734197 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:57.740555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.741011 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.741797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.742881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.889550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:57.897760 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a9f48f13-1835-4b4b-bcb9-f60b2944c427 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.168385 May 12 17:44:57.920292 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 154/317] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:57 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:57.932175 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:57.932835 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.933653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:57.940433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4aa211ee-3e14-4189-a19f-25748b1c7484 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.246964 May 12 17:44:57.941268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 164/318] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:57 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:57.951461 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.951958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.952955 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.953561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.985827 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.986448 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:57.995181 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.995631 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:57.996420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:57.996861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.184097 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:58.190409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:58.202174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e32b5338-3bde-4a53-9838-907a839081cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.220038 May 12 17:44:58.214327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5150ceb9-dd69-4229-9922-6beb7b3430e1 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.286638 May 12 17:44:58.214980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 165/319] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:57 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:58.217405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 155/320] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:57 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:58.221093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-af60e4b1-817b-4f38-8572-35a6b20b8de2 req-12903403-4845-45a5-aa2a-67e1a2e851fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b3f033-5f36-4355-8221-ab55bcba8722", "name": "network-vif-plugged", "status": "completed", "tag": "20f0b51d-9edf-437d-a233-3e26daa2ef7c"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:58.230552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:58.231191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:58.238468 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-af60e4b1-817b-4f38-8572-35a6b20b8de2 req-12903403-4845-45a5-aa2a-67e1a2e851fd service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.239193 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-af60e4b1-817b-4f38-8572-35a6b20b8de2 req-12903403-4845-45a5-aa2a-67e1a2e851fd service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.240871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.241229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.242847 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.243515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.252696 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-af60e4b1-817b-4f38-8572-35a6b20b8de2 req-12903403-4845-45a5-aa2a-67e1a2e851fd service nova] Creating event network-vif-plugged:20f0b51d-9edf-437d-a233-3e26daa2ef7c for instance 12b3f033-5f36-4355-8221-ab55bcba8722 on hv-cinder-83979 May 12 17:44:58.258305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-af60e4b1-817b-4f38-8572-35a6b20b8de2 req-12903403-4845-45a5-aa2a-67e1a2e851fd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041784 May 12 17:44:58.259465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 166/321] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:58.421068 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:58.471552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c03a508a-d651-4025-8b9a-30e950a80d9c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.249023 May 12 17:44:58.472649 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 156/322] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:58 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:58.548279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:58.549340 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:58.556825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.557287 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.558486 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.558800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.707413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:58.717326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:58.719211 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:58.720676 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-81eb1abe-8ae2-47bd-b8a3-cb4cde05b257 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.176908 May 12 17:44:58.721237 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 167/323] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:58 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:58.917556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:58.918366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:58.925199 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.925652 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.926433 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.926898 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.957583 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:58.958282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:58.965876 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.966724 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:58.967721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:58.968362 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.139550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.149273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ccbc04e1-6382-4743-932a-5597da477a42 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.237119 May 12 17:44:59.150375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 157/324] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:58 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:59.204453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.213794 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-84474b4d-2e70-499d-87ea-2b5ca9998351 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.259335 May 12 17:44:59.219172 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:59.220245 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:59.223294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 168/325] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:58 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:59.227663 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.228346 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.230124 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.230871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.235359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:59.236782 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:59.242849 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.243307 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.244089 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.244525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.392041 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.392658 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.403291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f94ecdf7-1f6a-420c-b290-75f80b029133 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.187775 May 12 17:44:59.406158 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2d35447a-3efc-4d67-9eee-0b94fb14856c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.176661 May 12 17:44:59.407928 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 158/326] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:59 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:59.416734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 169/327] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:59 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:44:59.494229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:59.495064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:59.508194 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.508649 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.509433 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.509869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.716958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.724772 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3b252b50-bdde-492f-926f-a67fd34504ac tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.235327 May 12 17:44:59.741315 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:59.742051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:44:59.745997 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 159/328] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:44:59 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:44:59.749090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.749540 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.750298 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:59.750743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:59.902225 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.912248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.914288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:44:59.916192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a2212b5a-1662-430d-8a51-5e66906615f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.178652 May 12 17:44:59.926955 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 170/329] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:44:59 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:00.178899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:00.184778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ed214278-6e8e-4bf2-9bac-9b4150ef5196 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ad46ee8-2b45-47da-941a-4df0bfc8072f", "device": "/dev/sdb"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:00.185674 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:00.189008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ed214278-6e8e-4bf2-9bac-9b4150ef5196 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:00.193808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.194458 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.197200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed214278-6e8e-4bf2-9bac-9b4150ef5196 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.197713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.198028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed214278-6e8e-4bf2-9bac-9b4150ef5196 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.198210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.199049 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed214278-6e8e-4bf2-9bac-9b4150ef5196 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.199715 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed214278-6e8e-4bf2-9bac-9b4150ef5196 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.365141 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:00.375679 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-35649e3f-b8dc-4fcc-98ef-a9df2ec22d75 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.208877 May 12 17:45:00.376806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 160/330] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:00 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:00.383226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:00.384216 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:00.391890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.392420 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.393673 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.394340 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.550335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:00.559166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-24dd51d3-d981-4d99-8ab0-7c02ce65fb12 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.181035 May 12 17:45:00.568493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 161/331] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:00 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:00.568493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:00.568493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:00.572289 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.572800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.573879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.574881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.776967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:00.785442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e35ac238-32ad-4b7c-9ccf-54b1457a2a1a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1363 microversion: 2.1 time: 0.224619 May 12 17:45:00.786242 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 162/332] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:00 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:00.791960 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:00.792990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:00.799744 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.800898 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.802082 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.802530 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.985181 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:00.993492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b1f5afda-64dc-4ef7-b3e2-23c510109c68 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.206028 May 12 17:45:01.003171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 163/333] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:00 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:01.008240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:01.008855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:01.022447 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.023608 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.024438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.025452 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.169610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:01.177797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b48e5490-7307-4da8-aef5-e3a651ad1758 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.173352 May 12 17:45:01.178376 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 164/334] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:01 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:01.192351 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:01.192960 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:01.200470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.200930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.201721 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.202156 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.350858 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:01.362523 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:01.364674 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:01.366297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b4f102d6-7595-436a-b3e2-df140ce8717e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.177548 May 12 17:45:01.368381 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 165/335] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:01 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:01.373489 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-cf0d816d-31cd-4c5d-bc30-6bce01554656 req-e9b781c1-7f4a-4211-94af-a10e89cf1a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176f48af-5412-4ccb-99e0-1431c7fce694", "name": "network-vif-plugged", "status": "completed", "tag": "50c3310e-fb35-4a1e-b702-1e8dd20ff13a"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:01.382273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-cf0d816d-31cd-4c5d-bc30-6bce01554656 req-e9b781c1-7f4a-4211-94af-a10e89cf1a86 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.383527 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-cf0d816d-31cd-4c5d-bc30-6bce01554656 req-e9b781c1-7f4a-4211-94af-a10e89cf1a86 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.397814 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-cf0d816d-31cd-4c5d-bc30-6bce01554656 req-e9b781c1-7f4a-4211-94af-a10e89cf1a86 service nova] Creating event network-vif-plugged:50c3310e-fb35-4a1e-b702-1e8dd20ff13a for instance 176f48af-5412-4ccb-99e0-1431c7fce694 on hv-cinder-83979 May 12 17:45:01.403905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-cf0d816d-31cd-4c5d-bc30-6bce01554656 req-e9b781c1-7f4a-4211-94af-a10e89cf1a86 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034345 May 12 17:45:01.404782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 166/336] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:01.409965 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:01.410922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:01.420866 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.421548 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.422728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.423170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.585540 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:01.606741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c7c9c17b-967c-45df-83f8-ee1f71e51997 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.200647 May 12 17:45:01.616060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 167/337] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:01 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:01.616060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:01.616060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:01.629712 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.630166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.630983 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.631574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.822645 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ed214278-6e8e-4bf2-9bac-9b4150ef5196 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "POST /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.642149 May 12 17:45:01.825959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 171/338] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:45:00 2022] POST /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4/os-volume_attachments => generated 194 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:45:01.826105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:01.839840 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d10b7015-e230-4529-bca4-8b0d2d8c988e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.230685 May 12 17:45:01.840603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 168/339] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:01 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:01.853399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:01.854396 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:01.861603 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.862395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:01.863600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:01.864411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.011302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:02.012190 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:02.020445 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.021186 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.023670 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.024315 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.133194 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:02.142109 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0986789f-b673-417e-9eb4-29174c15e5c8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1554 microversion: 2.1 time: 0.314540 May 12 17:45:02.155583 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 172/340] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:01 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1554 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:02.160900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f3859ece-17fc-4fa7-a1aa-47fc9c9be884 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:02.161627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f3859ece-17fc-4fa7-a1aa-47fc9c9be884 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:02.170080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3859ece-17fc-4fa7-a1aa-47fc9c9be884 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.170873 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3859ece-17fc-4fa7-a1aa-47fc9c9be884 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.171838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3859ece-17fc-4fa7-a1aa-47fc9c9be884 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.172512 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3859ece-17fc-4fa7-a1aa-47fc9c9be884 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.260643 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f3859ece-17fc-4fa7-a1aa-47fc9c9be884 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103563 May 12 17:45:02.261492 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 173/341] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:45:02 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:02.268749 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:02.269651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:02.285363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.286065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.287050 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.287634 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.421796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:02.431425 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-070c90e0-3b06-4cc2-bc1d-567e83cf5f04 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.425447 May 12 17:45:02.432213 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 169/342] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:02 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:02.447038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:02.447862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:02.455612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.456339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.457125 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.457561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.590043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:02.605770 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3f147289-69d3-4105-90d9-9426f4cf395d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.342995 May 12 17:45:02.606425 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 174/343] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:02 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:02.615576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:02.625089 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:02.626005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:02.626902 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:02.628482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:02.629989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-52838eab-0b10-4da2-9e2f-0bbcf54a4716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.189941 May 12 17:45:02.640821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 170/344] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:02 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:02.646279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.646965 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.647922 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.648783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.860958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:02.861894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:02.873952 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.874592 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.875570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.876073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.957996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:02.971747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-515b1a2f-0a4d-49c3-afa3-3455e271f640 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.350217 May 12 17:45:02.974934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 175/345] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:02 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:03.099672 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:03.109119 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2c5eed79-2ab2-4a0c-b930-d5c5d9a81d7f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.255365 May 12 17:45:03.110092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 171/346] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:02 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:03.451655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:03.452750 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:03.462395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:03.463382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:03.465027 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:03.465686 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:03.625034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:03.627609 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:03.641046 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:03.643591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:03.644767 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:03.646325 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:03.824257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:03.833328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e9a7b70d-95da-4e31-80b1-d5f9d58ed990 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.387924 May 12 17:45:03.844673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 176/347] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:03 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:03.851642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:03.852535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:03.859034 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:03.859751 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:03.860697 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:03.861271 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:03.908868 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:03.930821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b613d743-53da-4f95-82d5-aa3ca164d186 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.309097 May 12 17:45:03.943674 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 172/348] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:03 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:03.989600 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:03.990494 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:03.999550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:03.999997 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.000773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.001204 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.112937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:04.130251 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:04.133108 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:04.136979 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b58a6c39-ef3e-4202-bc1c-354ec8bb601a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.290623 May 12 17:45:04.138228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 177/349] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:03 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:04.143523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:04.144323 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:04.151422 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.152081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.154002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.155309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.237603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:04.246780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-27f800f0-0498-44ec-8940-f38d9ea634a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.261193 May 12 17:45:04.259516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 173/350] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:03 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:04.419402 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:04.429265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-614520fb-e5c1-4bce-8710-952ddfd9dc67 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.289587 May 12 17:45:04.437223 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 178/351] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:04 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:04.484808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-2cdf542c-9785-40eb-924b-c23e2b8ba4e8 req-bb7bc7f2-8e67-453d-844a-fc7b0c88f676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a5023a-5da1-4a91-a0ad-0775ff136725", "tag": "26a87193-d1d2-4c6e-ba24-c895c9893c18"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:04.493741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2cdf542c-9785-40eb-924b-c23e2b8ba4e8 req-bb7bc7f2-8e67-453d-844a-fc7b0c88f676 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.494105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2cdf542c-9785-40eb-924b-c23e2b8ba4e8 req-bb7bc7f2-8e67-453d-844a-fc7b0c88f676 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.509053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-2cdf542c-9785-40eb-924b-c23e2b8ba4e8 req-bb7bc7f2-8e67-453d-844a-fc7b0c88f676 service nova] Creating event network-changed:26a87193-d1d2-4c6e-ba24-c895c9893c18 for instance 05a5023a-5da1-4a91-a0ad-0775ff136725 on hv-cinder-83979 May 12 17:45:04.516652 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-2cdf542c-9785-40eb-924b-c23e2b8ba4e8 req-bb7bc7f2-8e67-453d-844a-fc7b0c88f676 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034906 May 12 17:45:04.523635 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 174/352] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:45:04.852123 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:04.853030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:04.862101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.865664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.866734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.867178 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.952847 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:04.954235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:04.961590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.962288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.963290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.963902 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.069446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.077444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2d538995-9992-4358-8be2-300877b5e524 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.229872 May 12 17:45:05.088619 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 179/353] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:04 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:05.155827 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:05.157566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:05.170471 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:05.170993 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.171774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:05.172216 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.177512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.191871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-afa448a6-3a9d-470e-baf3-c59f7c4cb560 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.243670 May 12 17:45:05.193446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 175/354] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:04 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:05.265571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:05.266558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:05.274095 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:05.275840 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.277239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:05.278490 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.427612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.438535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.441061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.442562 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-657679e3-0140-461b-bde9-47e2d3abf19f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.290909 May 12 17:45:05.443970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 180/355] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:05 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:05.453361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:05.458984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:05.472821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:05.473285 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.477969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:05.478321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.520735 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.536566 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-cf79adb7-e4e8-407c-a26b-7c01fb639d6f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.274841 May 12 17:45:05.537383 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 176/356] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:05 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:05.600924 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-25608a18-c00d-420f-86be-06be94990a8e req-c2a16389-070c-49ed-b51b-0fb4e1b62670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a1ff6d-1105-476b-880e-39e5d783b0a2", "name": "network-vif-plugged", "status": "completed", "tag": "aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:05.613160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-25608a18-c00d-420f-86be-06be94990a8e req-c2a16389-070c-49ed-b51b-0fb4e1b62670 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:05.613933 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-25608a18-c00d-420f-86be-06be94990a8e req-c2a16389-070c-49ed-b51b-0fb4e1b62670 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.633984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-25608a18-c00d-420f-86be-06be94990a8e req-c2a16389-070c-49ed-b51b-0fb4e1b62670 service nova] Creating event network-vif-plugged:aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4 for instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 on hv-cinder-83979 May 12 17:45:05.639335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-25608a18-c00d-420f-86be-06be94990a8e req-c2a16389-070c-49ed-b51b-0fb4e1b62670 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043735 May 12 17:45:05.643430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 177/357] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:05.718694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.730276 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a86e8ee8-b516-4c75-be68-b5ee4381412d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.280665 May 12 17:45:05.731284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 181/358] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:05 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:06.102367 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:06.103325 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:06.111456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.112185 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.113108 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.113649 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.211022 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:06.212424 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:06.221163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.223407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.224216 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.224664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.276392 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:06.301855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ce68282c-38ce-4e1a-85e9-97d8a3ea8222 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1313 microversion: 2.1 time: 0.203985 May 12 17:45:06.308895 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 178/359] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:06 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:06.401655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:06.410392 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-803ccf50-000d-443c-8ac9-764d50c79112 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.204109 May 12 17:45:06.422316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 182/360] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:06 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:06.464033 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:06.464736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:06.474568 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.475205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.476971 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.477877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.553865 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:06.555493 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:06.563094 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.564550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.565542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.565986 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.645791 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:06.669213 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:06.674195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:06.675496 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4f24a28d-9568-44b1-b7ab-62f02cabd7d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.216455 May 12 17:45:06.686227 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 179/361] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:06 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:06.738158 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:06.747672 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:06.748270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:06.748764 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-44b3bb61-1ba2-4ecf-b291-3a9fcbd659de tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.198898 May 12 17:45:06.749757 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 183/362] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:06 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:06.755347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.755845 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.756628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.757069 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.966172 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:06.975367 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e5d3921e-7b9c-4e8d-b894-ac5396a0d04e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.231395 May 12 17:45:06.977207 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 180/363] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:06 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:07.326062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:07.326741 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:07.333303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.333786 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.334574 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.335033 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.430312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:07.430967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:07.438129 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.438899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.440147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.440736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.500837 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:07.509050 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fe4fc995-d02b-47dd-9191-bf7134e6847c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1498 microversion: 2.1 time: 0.187263 May 12 17:45:07.509888 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 184/364] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:07 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:07.606576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:07.619193 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c200aa83-6bad-4da5-a5be-90dbe55aa754 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.193664 May 12 17:45:07.633749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 181/365] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:07 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:07.693912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:07.694530 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:07.703942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.704396 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.705177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.705615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.768348 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:07.769462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:07.777422 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.779335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.784817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:07.785580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.956266 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:07.965802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:07.967764 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:07.969510 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1686e3fa-bc92-4e10-8fb5-1076521db678 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.279737 May 12 17:45:07.980409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 185/366] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:07 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:07.993783 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:07.994054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:07.994692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.000937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.001397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.002105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6c56bc95-7e43-433c-b08b-fd5023fa100a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.238940 May 12 17:45:08.002239 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.002614 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.012447 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 182/367] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:07 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:08.157556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:08.157556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.167852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.167852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.168506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.168506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.173363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:08.180773 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-77996515-da1d-4802-8a04-15560002f580 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1500 microversion: 2.1 time: 0.191408 May 12 17:45:08.181424 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 186/368] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:07 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1500 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:08.196352 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:45:08.198703 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0022a511-045b-4a24-9dfc-1f08579563ed"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:08.199891 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.206376 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.206870 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.207653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.208111 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.232905 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] HTTP exception thrown: Cannot 'attach_volume' instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a while it is in vm_state rescued May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Request method failure captured: May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: POST /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a/os-volume_attachments HTTP/1.1 May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 74 May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUdSt7CuCtUuj1igLX403WPelXYYDhXrwsO_WFe9JIdu0Ze95DTlZWoLml0rwnxVW9-Oh59tmCNB6nEzSTue2tK2cUC1lGABUpQMzFwg4Bc_7pYb8bQT_-xcCJCGM1AkYtQj250Vp1sCL8Mmg8LNaK-Yn-UhT8sHeKHWRlQ2Kau6WsA May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:45:08.234652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bcee5099fd2b4df2adaa069af3a45733", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ee532b08897148dd9ff0482a00f537f7 May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {"volumeAttachment": {"volumeId": "0022a511-045b-4a24-9dfc-1f08579563ed"}} May 12 17:45:08.236054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Cannot 'attach_volume' instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a while it is in vm_state rescued May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'server_id': 'f9fe1954-0d79-4a7b-a18f-463a1e44b42a', 'body': {'volumeAttachment': {'volumeId': '0022a511-045b-4a24-9dfc-1f08579563ed'}}} May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:45:08.236999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a while it is in vm_state rescued May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:45:08.238161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:45:08.240629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:45:08.240629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:45:08.240629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a while it is in vm_state rescued May 12 17:45:08.240629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:45:08.240629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Returning 409 to user: Cannot 'attach_volume' instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a while it is in vm_state rescued {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:45:08.240629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-db6bdcee-c190-4ca8-8faf-27ea24568694 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042374 May 12 17:45:08.240629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 187/369] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:45:08 2022] POST /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 12 17:45:08.248012 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-25b5720e-c0db-48ef-bfdd-4a7d6f339c88 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:08.248541 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-25b5720e-c0db-48ef-bfdd-4a7d6f339c88 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.254353 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25b5720e-c0db-48ef-bfdd-4a7d6f339c88 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.254849 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25b5720e-c0db-48ef-bfdd-4a7d6f339c88 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.255627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25b5720e-c0db-48ef-bfdd-4a7d6f339c88 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.256059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25b5720e-c0db-48ef-bfdd-4a7d6f339c88 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.286625 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ec3bb0ea-6278-4cd4-872e-f8bf49128a3b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "DELETE /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 204 len: 0 microversion: 2.1 time: 0.133090 May 12 17:45:08.287665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 183/370] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:45:08 2022] DELETE /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:45:08.299048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:08.300103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.307553 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.308289 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.309327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.309922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.356478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-25b5720e-c0db-48ef-bfdd-4a7d6f339c88 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a/action" status: 202 len: 0 microversion: 2.1 time: 0.113837 May 12 17:45:08.357316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 188/371] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:45:08 2022] POST /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:45:08.365538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:08.366257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.373155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.373605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.374376 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.374914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.455979 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:08.463856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c80d19d3-8ac1-4c87-b58d-e2bb4fdab995 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1504 microversion: 2.1 time: 0.170485 May 12 17:45:08.464532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 184/372] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:08 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:08.505260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:08.513184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9b182df1-1ed3-4ea5-8e47-26dd3faba198 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.151759 May 12 17:45:08.513755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 189/373] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:08 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:08.636538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:08.637148 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.643279 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.643736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.644506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.644947 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.771843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:08.779841 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-87ac901e-82b5-4425-a8de-fe41531cf5c6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.147764 May 12 17:45:08.780416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 185/374] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:08 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:08.989066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:08.989582 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.996735 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.997191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.997963 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.998405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.019568 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:09.020168 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:09.026361 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.026848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.027618 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.028082 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.162040 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:09.180692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:09.182205 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:09.183382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7e25fc33-a9c8-4ce0-85b3-e44dc240e243 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.198388 May 12 17:45:09.190803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 190/375] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:08 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:09.202826 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:09.210194 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b6916a0b-e90b-4216-b0a6-46ef5602acc4 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.194777 May 12 17:45:09.212091 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 186/376] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:09 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:09.481155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:09.481793 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:09.488180 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.488638 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.489414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.489854 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.531239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:09.531747 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:09.538094 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.539133 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.539925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.540366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.621197 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:09.628603 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5b4b84dc-f63c-4125-983b-602f4a032f61 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1504 microversion: 2.1 time: 0.151354 May 12 17:45:09.629300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 191/377] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:09 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:09.672873 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:09.680253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-80df8f4d-f95e-4d5c-b40f-4ec784954ab6 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.152887 May 12 17:45:09.680819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 187/378] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:09 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:09.797637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:09.798186 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:09.804123 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.805092 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.805861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.806320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.935394 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:09.943271 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6bfc435d-ca9d-49cc-8a1e-b74ebebe9740 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.149606 May 12 17:45:09.943830 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 192/379] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:09 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:10.202969 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:10.204027 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:10.211251 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.211869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.213030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.213688 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.229591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:10.230198 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:10.236143 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.236593 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.237360 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.237800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.353873 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:10.361587 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:10.363113 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:10.364261 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-775dbf7f-9f3c-4ed2-b487-3377f24ac471 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.166116 May 12 17:45:10.364833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 188/380] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:10 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:10.368560 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:10.375940 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-501d441c-e59f-4808-b3d4-7ff8b8c70df0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.151449 May 12 17:45:10.376497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 193/381] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:10 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:10.646396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:10.647022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:10.653779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.654228 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.655023 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.655465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.697174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:10.697805 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:10.703811 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.704263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.705038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.705476 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.790588 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:10.797918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f4701384-9b23-41bb-8d4a-5ba9c642c4ea tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1504 microversion: 2.1 time: 0.155682 May 12 17:45:10.798483 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 189/382] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:10 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:10.839254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:10.847040 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-44dfdc99-2333-4e4f-bd5f-24754ee81585 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.153632 May 12 17:45:10.847860 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 194/383] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:10 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:10.961715 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:10.962331 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:10.968268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.968744 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:10.969508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:10.969942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.203996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:11.213211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-df09595a-731f-4136-9d1e-f44e1fa7bbf4 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.256068 May 12 17:45:11.213792 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 190/384] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:10 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:11.383790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:11.384397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:11.390492 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.390966 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.391735 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.392174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.392328 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:11.392915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:11.399327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.399781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.400584 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.401022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.524236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:11.532501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:11.534132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:11.535427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1afbead3-9bd1-4b6f-8bc7-dd5422417d0c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1741 microversion: 2.20 time: 0.156141 May 12 17:45:11.536337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 195/385] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:11 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:11.540007 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:11.547726 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6a74cc9a-5930-48ab-aa17-b95421cb195c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.159296 May 12 17:45:11.548290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 191/386] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:11 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:11.815936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:11.816483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:11.823483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.823940 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.824710 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.825151 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.864985 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:11.865596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:11.872254 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.872707 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.873486 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:11.873920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.955619 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:11.964057 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e9c5ed45-3d7e-4bf6-a8ae-2503298c53ed tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1504 microversion: 2.1 time: 0.152049 May 12 17:45:11.964625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 196/387] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:11 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:12.006236 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:12.013995 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-dcb09522-2537-4356-a923-8876a77c96cd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.152829 May 12 17:45:12.014564 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 192/388] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:11 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:12.230382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:12.231047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:12.237240 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.237692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.238464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.238951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.367931 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:12.375862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-edbdf49b-022f-41ab-b1f1-2c9d16207956 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.149564 May 12 17:45:12.376460 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 197/389] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:12 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:12.553358 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:12.554018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:12.562837 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.563501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.564503 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.565092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.568434 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:12.572331 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:12.580162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.580839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.582475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.582962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.729381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:12.737039 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f6b8302e-8ac0-4424-a064-f7799b39df14 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.175350 May 12 17:45:12.737690 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 198/390] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:12 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:12.739030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:12.747083 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:12.748578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:12.749752 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-20073370-3b72-4d26-b51b-d798d6e5976d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.200469 May 12 17:45:12.750294 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 193/391] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:12 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:12.980905 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:12.981512 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:12.987796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.988245 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.989011 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.989446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.031670 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:13.032271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:13.038651 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.039256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.040137 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.040574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.119577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:13.126948 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b2a584f8-6a4b-4e72-9c3e-ca0d27447b0c tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1504 microversion: 2.1 time: 0.149883 May 12 17:45:13.127516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 199/392] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:12 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:13.167408 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:13.174641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c17426c7-8350-4f63-a8e8-2b1b15a2f176 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.146800 May 12 17:45:13.175223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 194/393] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:13 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:13.393591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:13.394199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:13.402711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.403856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.405187 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.405887 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.610088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:13.620106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1da1d9c6-85c2-46ec-86b5-67e8fc92955e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.230500 May 12 17:45:13.621577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 200/394] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:13 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:13.754316 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:13.754996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:13.763697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.764195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.765306 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.766113 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.771140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:13.772102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:13.779699 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.780886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.781986 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.782637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.972685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:13.982495 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:13.984220 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:13.985470 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-41916f57-cfa9-4a46-882b-465c8b505f6b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.220536 May 12 17:45:13.989008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 201/395] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:13 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:14.016799 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:14.024462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ae577223-2111-43c3-9e9f-103413a3d230 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1265 microversion: 2.1 time: 0.274869 May 12 17:45:14.025193 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 195/396] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:13 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:14.028757 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-5c2a35af-5b37-45a4-8fa8-b37226db393b req-871a3023-fe36-4bc7-8d76-cb380384816a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176f48af-5412-4ccb-99e0-1431c7fce694", "name": "network-vif-deleted", "tag": "50c3310e-fb35-4a1e-b702-1e8dd20ff13a"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:14.037153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-5c2a35af-5b37-45a4-8fa8-b37226db393b req-871a3023-fe36-4bc7-8d76-cb380384816a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.037596 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-5c2a35af-5b37-45a4-8fa8-b37226db393b req-871a3023-fe36-4bc7-8d76-cb380384816a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.050399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-5c2a35af-5b37-45a4-8fa8-b37226db393b req-871a3023-fe36-4bc7-8d76-cb380384816a service nova] Creating event network-vif-deleted:50c3310e-fb35-4a1e-b702-1e8dd20ff13a for instance 176f48af-5412-4ccb-99e0-1431c7fce694 on hv-cinder-83979 May 12 17:45:14.055853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-5c2a35af-5b37-45a4-8fa8-b37226db393b req-871a3023-fe36-4bc7-8d76-cb380384816a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030925 May 12 17:45:14.056429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 202/397] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:45:14.144611 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:14.145216 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:14.152006 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.152458 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.153223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.153658 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.192920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:14.193666 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:14.200851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.201297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.202066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.202495 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.217750 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:14.224955 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c111e46d-060b-4af5-92e6-d63fcc6cc85b tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1462 microversion: 2.1 time: 0.084437 May 12 17:45:14.225529 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 196/398] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:14 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:14.331544 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:14.339491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-03d7395f-eceb-4065-8393-b2604de63401 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.150666 May 12 17:45:14.340053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 203/399] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:14 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:14.638657 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:14.639311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:14.645448 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.645895 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.646662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.647127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.777117 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:14.784832 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b168a4d6-44aa-41b2-9450-aae7adfb8e83 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.150090 May 12 17:45:14.785384 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 197/400] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:14 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:15.004464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:15.005069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:15.011340 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.011798 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.012569 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.013010 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.042031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:15.042627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:15.048544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.048989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.049754 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.050186 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.146702 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.155344 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.156828 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.157973 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7377cb78-97bd-423f-bcaa-193cb9f23dae tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.157393 May 12 17:45:15.158525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 204/401] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:14 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:15.182456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.190175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2ec0ff8c-d912-454e-a288-1cbac395334f tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1452 microversion: 2.1 time: 0.152968 May 12 17:45:15.190746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 198/402] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:15 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:15.206546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:15.207180 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:15.213865 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.214316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.215187 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.215754 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.242116 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:15.242914 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:15.249958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.250408 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.251218 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.251655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.313368 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.320925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-58e030aa-03c5-46aa-93d9-df1c61266b45 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1462 microversion: 2.1 time: 0.082670 May 12 17:45:15.321585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 199/403] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:15 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:15.346111 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.354368 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-343a1516-3cc4-4366-972f-61ba7786c2ab tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1452 microversion: 2.1 time: 0.151773 May 12 17:45:15.354970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 205/404] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:15 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:15.357076 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:15.357680 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:15.363506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.363961 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.364725 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.365159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.501087 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.508934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-eca97533-bdb7-4baa-9701-6fcc4edc3ae1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.155601 May 12 17:45:15.509632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 200/405] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:15 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:15.692498 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-a7421a31-aa1d-4fc4-8f43-230a11973ff5 req-631a732f-7142-407b-aea6-810813379459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b3f033-5f36-4355-8221-ab55bcba8722", "name": "network-vif-unplugged", "status": "completed", "tag": "20f0b51d-9edf-437d-a233-3e26daa2ef7c"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:15.701047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-a7421a31-aa1d-4fc4-8f43-230a11973ff5 req-631a732f-7142-407b-aea6-810813379459 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.701493 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-a7421a31-aa1d-4fc4-8f43-230a11973ff5 req-631a732f-7142-407b-aea6-810813379459 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.712570 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-a7421a31-aa1d-4fc4-8f43-230a11973ff5 req-631a732f-7142-407b-aea6-810813379459 service nova] Creating event network-vif-unplugged:20f0b51d-9edf-437d-a233-3e26daa2ef7c for instance 12b3f033-5f36-4355-8221-ab55bcba8722 on hv-cinder-83979 May 12 17:45:15.717430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-a7421a31-aa1d-4fc4-8f43-230a11973ff5 req-631a732f-7142-407b-aea6-810813379459 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028569 May 12 17:45:15.718028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 206/406] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:15.802655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:15.803275 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:15.810233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.810723 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.811546 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.811981 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:15.941273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.949508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-08e9df4a-9e5a-4d3d-99ef-d401c002277e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.150898 May 12 17:45:15.950074 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 201/407] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:15 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:16.177099 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:16.177815 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:16.184295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.184740 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.185494 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.185919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.337865 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:16.338466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:16.344987 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.345420 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.346193 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.346632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.404927 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:16.409858 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:16.413114 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:16.415329 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:16.416579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-35fe8ced-5e5f-4e44-ab79-bb062fec8832 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.244210 May 12 17:45:16.417288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 207/408] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:16 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:16.417762 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-259ffc55-8464-4b47-b9ec-88d3dfeca851 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1462 microversion: 2.1 time: 0.084682 May 12 17:45:16.418438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 202/409] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:16 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:16.525788 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:16.526531 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:16.532457 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.532989 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.533830 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.534343 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.714911 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:16.722316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fbf46e0b-eb8e-47b2-ad9f-93be1d690e27 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.200676 May 12 17:45:16.722936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 208/410] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:16 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:16.967595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:16.968371 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:16.974604 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.975093 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.975925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.977065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.116293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:17.125333 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-af721d6b-8895-4014-95e8-563d13cf2588 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.161562 May 12 17:45:17.125915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 203/411] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:16 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:17.435484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:17.436111 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:17.436457 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:17.436551 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:17.442520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.443250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.444478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.445665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.473278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.473735 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.474516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.474980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.552902 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:17.561750 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-be11d14e-70ab-4860-940e-6f11bcbebe0d tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1462 microversion: 2.1 time: 0.129916 May 12 17:45:17.562332 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 209/412] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:17 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1462 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:17.566939 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-6a566d15-d1a5-4538-b463-8b7b4b11c1a3 req-05f3feda-a958-44eb-be88-e7a727f8cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a1ff6d-1105-476b-880e-39e5d783b0a2", "tag": "aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:17.577116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-6a566d15-d1a5-4538-b463-8b7b4b11c1a3 req-05f3feda-a958-44eb-be88-e7a727f8cc3e service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.577566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-6a566d15-d1a5-4538-b463-8b7b4b11c1a3 req-05f3feda-a958-44eb-be88-e7a727f8cc3e service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.588513 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:17.588867 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-6a566d15-d1a5-4538-b463-8b7b4b11c1a3 req-05f3feda-a958-44eb-be88-e7a727f8cc3e service nova] Creating event network-changed:aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4 for instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 on hv-cinder-83979 May 12 17:45:17.594306 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-6a566d15-d1a5-4538-b463-8b7b4b11c1a3 req-05f3feda-a958-44eb-be88-e7a727f8cc3e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030448 May 12 17:45:17.595250 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 210/413] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:17.597550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:17.599113 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:17.600302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8164fa71-b5f3-41ed-85b3-f0acdb20c716 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.168680 May 12 17:45:17.600903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 204/414] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:17 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:17.740691 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:17.741400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:17.748143 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.748596 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.749363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.749802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.882196 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:17.889475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6e27d136-3bfe-450a-b099-aac740eed552 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.153134 May 12 17:45:17.890452 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 211/415] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:17 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:18.142263 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:18.143745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:18.152716 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.153381 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.163171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.164401 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.403541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:18.415698 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-378a17dc-ed3f-4e92-ba29-da4ac5c15d09 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.277265 May 12 17:45:18.416389 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 205/416] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:18 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:18.579616 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:18.580227 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:18.587543 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.587999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.588780 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.589221 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.619415 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:18.620011 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:18.621057 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.621519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.621972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:18.626425 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.627034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.627984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.628414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.664077 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:18.671628 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-692d2049-4da4-4523-8b35-bb133b792a3e tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.095874 May 12 17:45:18.672388 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 212/417] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:18 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:18.765435 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:18.775016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:18.776722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:18.778061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-15e3dfcd-9432-4254-982b-79c5bf175758 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.163136 May 12 17:45:18.785307 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 206/418] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:18 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:18.906681 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:18.907304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:18.913220 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.913747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.914520 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.914987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.044221 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.051571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5a1816ee-1df1-41ae-b3c8-f7c3cfe764c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.148743 May 12 17:45:19.052131 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 213/419] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:18 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:19.433111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:19.433722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:19.439843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.440294 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.441064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.441501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.567000 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.575813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7b36c4fb-c291-4b07-aad0-085f255f0cd7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.147102 May 12 17:45:19.576375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 207/420] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:19 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:19.689143 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:19.689752 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:19.696685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.697143 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.697914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.698353 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.728294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.728775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.729220 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:19.770782 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.778172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c9fbe5d5-e3e1-43a3-ac3a-fdecc9cd7000 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.092872 May 12 17:45:19.778753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 214/421] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:19 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:19.796247 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:19.796843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:19.803382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.803827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.805155 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.805584 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.934492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.942300 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.943843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.945782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9efabd0f-035c-47b0-a833-052d8c4261d4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.153296 May 12 17:45:19.946363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 208/422] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:19 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:20.068967 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:20.069586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:20.075558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.076004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.076768 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.077206 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.202826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:20.209975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-02235232-1497-41c0-8344-d0d4c7089ae7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.144839 May 12 17:45:20.211307 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 215/423] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:20 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:20.592636 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:20.593238 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:20.599093 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.599546 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.600596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.601380 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.729101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:20.736811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1930eb89-16cc-4fe4-9d71-9569ec5493de tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.148103 May 12 17:45:20.737346 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 209/424] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:20 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:20.794570 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:20.795231 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:20.801574 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.802051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.802887 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.803330 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.833662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.834113 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.834556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:20.877595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:20.884993 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-053d9e57-1732-450a-9cba-e3d236fe10b4 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.094259 May 12 17:45:20.885552 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 216/425] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:20 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:20.965853 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:20.966451 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:20.972691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.973138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.973894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.974326 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.100135 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.108421 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.109935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.111175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4bf49e4b-e2b1-43f0-9c1f-fcdefb291284 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.149104 May 12 17:45:21.111733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 210/426] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:20 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:21.228530 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:21.229124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:21.235088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.235536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.236299 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.236728 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.363300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.370627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-17e6b1e0-47a8-4363-90cc-ccb6b7d528b2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.146874 May 12 17:45:21.371212 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 217/427] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:21 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:21.754797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:21.755401 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:21.761829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.762277 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.763064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.763497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.896427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.901423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:21.902031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:21.904878 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4a9e80bf-3897-431f-9e23-f149741a7f1d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.154013 May 12 17:45:21.905464 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 211/428] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:21 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:21.908586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.909041 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.909817 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.910253 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.942046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.942498 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.942973 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:21.983401 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.990593 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-00008880-dcce-4954-80ca-a7219f915a44 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.093231 May 12 17:45:21.991186 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 218/429] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:21 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:22.129256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:22.129861 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:22.137385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.137903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.138691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.139143 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.273328 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.281142 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.282656 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.283824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ffb6b7c3-c409-4aa5-9837-26649b93950d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.158470 May 12 17:45:22.284608 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 212/430] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:22 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:22.387950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:22.388475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:22.394647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.395127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.395890 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.396326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.528628 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.537062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c77f9752-ec06-47ec-8588-67bc599ad7da tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.153015 May 12 17:45:22.537637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 219/431] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:22 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:22.922038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:22.922637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:22.928821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.929276 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.930124 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.930559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.008354 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:23.009089 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:23.015375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.015828 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.016604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.017040 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.048459 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.048915 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.049359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:23.062211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:23.071033 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4c38b4f0-8b08-47fe-badd-e6d03dfe0637 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.152484 May 12 17:45:23.071623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 213/432] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:22 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:23.090025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:23.097248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8420f7a2-e592-4ce2-baf5-3aa1705775bc tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.093495 May 12 17:45:23.098068 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 220/433] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:23 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:23.302938 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:23.303542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:23.310564 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.311055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.311825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.312265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.439407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:23.447147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:23.448653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:23.449798 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b29fa733-74b4-4f94-8b86-a28ba9503b5f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.150832 May 12 17:45:23.450347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 214/434] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:23 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:23.555213 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:23.555772 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:23.561633 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.562081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.562874 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.563311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.692565 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:23.701326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5b11d10b-54a9-4fc3-bec5-3fd812a7f861 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.150218 May 12 17:45:23.701941 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 221/435] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:23 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:24.088909 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:24.089501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:24.095500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.095884 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.096639 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.097070 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.113816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:24.114426 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:24.120937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.121398 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.122167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.122612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.154338 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.154992 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.155641 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:24.199776 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.206916 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-eaabe4ee-fce2-420e-85e3-005e35963b41 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.096942 May 12 17:45:24.207478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 222/436] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:24 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:24.225533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.234170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0748168b-f3ec-4a31-a42f-50edbcf32a55 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.149850 May 12 17:45:24.234920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 215/437] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:24 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:24.468523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:24.469047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:24.474840 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.475292 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.476166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.477098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.603476 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.611059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.612547 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.613683 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-48dcd5a0-9c7c-4532-9bfe-d676d300ebcb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.149175 May 12 17:45:24.614234 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 223/438] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:24 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:24.719453 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:24.719968 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:24.726263 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.726821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.727587 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.728024 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.857029 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.864243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-20f8b389-ee5e-47d0-9aea-e07b7c7044fa tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.148827 May 12 17:45:24.865119 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 216/439] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:24 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:25.224550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:25.225159 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:25.231816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.232272 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.233043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.233483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.250315 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:25.250973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:25.256693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.257142 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.257905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.258961 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.265105 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.265565 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.266694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:25.308703 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.316205 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-905ababc-bcb9-4ebe-8110-d71f471badd3 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.095502 May 12 17:45:25.316782 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 224/440] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:25 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:25.386568 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.394404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1a8a4f94-00ee-4896-92ac-df5974493e7e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.147973 May 12 17:45:25.395005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 217/441] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:25 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:25.632450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:25.633745 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:25.639665 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.640139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.640905 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.641340 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.781439 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.789126 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.790630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.791795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-05e91fdb-dd22-4d13-bc32-b9180b01ed2c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.163589 May 12 17:45:25.792347 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 225/442] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:25 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:25.881385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:25.881992 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:25.888961 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.889443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.890208 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.890635 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.022147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.030140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b0007d80-b90e-4328-9adc-2c71c45ce7b3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.152623 May 12 17:45:26.030718 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 218/443] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:25 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:26.333410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:26.334014 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:26.340515 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.340960 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.341721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.342155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.372139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.372585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.373026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:26.412907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.413171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:26.413780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:26.419815 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.420167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-163b7799-8286-4c51-9aa0-d781db2db383 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.090614 May 12 17:45:26.420288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.420728 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 226/444] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:26 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:26.421026 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.421461 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.552216 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.560372 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-351a2180-c15d-40c9-b06b-b1e9b9dcc72b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1724 microversion: 2.1 time: 0.151653 May 12 17:45:26.560938 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 219/445] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:26 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:26.811755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:26.812358 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:26.818069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.818497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.819302 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.819720 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.948447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.956172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.957679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.958859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-34cc5b4f-5d4e-4632-b903-983dc774cfa7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1723 microversion: 2.20 time: 0.151053 May 12 17:45:26.959417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 227/446] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:26 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:27.048256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:27.048768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:27.054633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.056982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.057766 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.058202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.187616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:27.194945 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2f4f4427-0084-4910-ab11-9f11c3732ea9 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1508 microversion: 2.1 time: 0.150842 May 12 17:45:27.195591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 220/447] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:27 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:27.437093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:27.437720 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:27.444609 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.445095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.446549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.447026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.478001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.478447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.478930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lazy-loading 'fault' on Instance uuid 176f48af-5412-4ccb-99e0-1431c7fce694 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:27.529411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967a537eb434465e8294c324a83ef5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75736e80e44a481484d88e394c5269d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:27.537105 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8fa56e81-a3e2-4c6b-9691-4b5f3ce90624 tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 200 len: 1303 microversion: 2.1 time: 0.103958 May 12 17:45:27.537721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 228/448] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:27 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:27.580714 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:27.581461 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:27.589624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.590116 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.590881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.591322 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.963039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:27.970906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-85a14e7f-744e-457e-8f6d-84a2bb120e51 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1701 microversion: 2.1 time: 0.394813 May 12 17:45:27.971473 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 221/449] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:27 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1701 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:27.977300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:27.977908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:27.983834 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.984298 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.985080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.985519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.987277 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6957fe42-b9f0-4799-a59f-9360a65ef16b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:27.993755 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6957fe42-b9f0-4799-a59f-9360a65ef16b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.994214 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6957fe42-b9f0-4799-a59f-9360a65ef16b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.016870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6957fe42-b9f0-4799-a59f-9360a65ef16b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Going to try to start instance {{(pid=123688) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 17:45:28.059155 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6957fe42-b9f0-4799-a59f-9360a65ef16b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.075392 May 12 17:45:28.059823 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 222/450] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:45:27 2022] POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:45:28.068854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:28.069556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.077398 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.077965 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.078844 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.079252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.125155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:28.133750 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:28.135314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:28.136462 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c2421c3e-59e0-4e45-8990-8fd1f4a5d04c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1726 microversion: 2.20 time: 0.163091 May 12 17:45:28.137018 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 229/451] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:27 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:28.154030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-89a9dddb-d0c5-4097-9cc0-7af741bf830d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce014f5b-969b-4219-a730-a2a095c8df80"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:28.155125 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-89a9dddb-d0c5-4097-9cc0-7af741bf830d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.160958 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89a9dddb-d0c5-4097-9cc0-7af741bf830d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.161892 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89a9dddb-d0c5-4097-9cc0-7af741bf830d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.162182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89a9dddb-d0c5-4097-9cc0-7af741bf830d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.162623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89a9dddb-d0c5-4097-9cc0-7af741bf830d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.215655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:28.225315 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0f1ceef6-10ff-4eb4-a4ec-3c76fa3e669d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1710 microversion: 2.1 time: 0.161250 May 12 17:45:28.226031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 223/452] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:28 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:28.245211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:28.245769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.254570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.255329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.256435 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.256913 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.438210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:28.448897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8271ca0a-c0da-451d-a94c-b0514a156125 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1514 microversion: 2.1 time: 0.220893 May 12 17:45:28.449630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 224/453] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:28 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:28.488161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-89a9dddb-d0c5-4097-9cc0-7af741bf830d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337892 May 12 17:45:28.488800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 230/454] 10.222.0.76 () {62 vars in 1363 bytes} [Thu May 12 17:45:28 2022] POST /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:45:28.553011 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:28.553630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] [instance: 176f48af-5412-4ccb-99e0-1431c7fce694] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.560327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.560780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.561731 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.563112 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.577247 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] HTTP exception thrown: Instance 176f48af-5412-4ccb-99e0-1431c7fce694 could not be found. May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Request method failure captured: May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 HTTP/1.1 May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUd3j0v2qdkD_eKw98_ut3UfgJdYfLx6EHnEa8obBC8HTEPzD9-L3lQjsa3Thp0SYmdIRnjWMj9jmGgU953BfOoCN9JFjT7XjVdKoN9jg_lN5taFTpJlYnsrK77x4s0_PdnBVSovPnt_Vclf2jqBdWLVApN7ZsGXIOTy6tydZ8H33mI May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 75736e80e44a481484d88e394c5269d6 May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-VolumesActionsTest-1686172247 May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:45:28.578944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75736e80e44a481484d88e394c5269d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_75736e80e44a481484d88e394c5269d6", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/75736e80e44a481484d88e394c5269d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/75736e80e44a481484d88e394c5269d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-VolumesActionsTest-1686172247 May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 75736e80e44a481484d88e394c5269d6 May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-VolumesActionsTest-1686172247 May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-VolumesActionsTest-1686172247-project May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 967a537eb434465e8294c324a83ef5b0 May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-VolumesActionsTest-1686172247-project May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 176f48af-5412-4ccb-99e0-1431c7fce694 could not be found. May 12 17:45:28.580544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '176f48af-5412-4ccb-99e0-1431c7fce694'} May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 176f48af-5412-4ccb-99e0-1431c7fce694 could not be found. May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:45:28.581442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 176f48af-5412-4ccb-99e0-1431c7fce694 could not be found. May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 176f48af-5412-4ccb-99e0-1431c7fce694 could not be found. May 12 17:45:28.582855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:28.584119 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] Returning 404 to user: Instance 176f48af-5412-4ccb-99e0-1431c7fce694 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:45:28.584119 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ae71905d-c9da-4453-bc55-bccb1c42d5ac tempest-VolumesActionsTest-1686172247 tempest-VolumesActionsTest-1686172247-project] 10.222.0.76 "GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694" status: 404 len: 111 microversion: 2.1 time: 0.031377 May 12 17:45:28.584119 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 225/455] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:28 2022] GET /compute/v2.1/servers/176f48af-5412-4ccb-99e0-1431c7fce694 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:45:28.615843 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ca04bce2-af02-4678-b981-e6aec5636a6e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:28.616637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ca04bce2-af02-4678-b981-e6aec5636a6e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.632305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ca04bce2-af02-4678-b981-e6aec5636a6e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.632968 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ca04bce2-af02-4678-b981-e6aec5636a6e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.634265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ca04bce2-af02-4678-b981-e6aec5636a6e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.634758 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ca04bce2-af02-4678-b981-e6aec5636a6e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.793443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ca04bce2-af02-4678-b981-e6aec5636a6e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/action" status: 202 len: 0 microversion: 2.20 time: 0.181779 May 12 17:45:28.794571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 231/456] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 12 17:45:28 2022] POST /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 17:45:28.807105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:28.807846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.818854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.819440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.821012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.821996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.092229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.101470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.103741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.111305 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-15b15c47-9f86-4dc7-838c-3d2c314e1dfb tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1812 microversion: 2.20 time: 0.305527 May 12 17:45:29.112660 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 226/457] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:28 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1812 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:29.251661 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:29.252273 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:29.259463 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:29.260221 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.261478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:29.262101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.527717 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.535513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-146e8ee7-8f9b-4078-8910-1f8f06daf7b6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1710 microversion: 2.1 time: 0.287708 May 12 17:45:29.546467 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 232/458] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:29 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1710 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:29.811862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-453ac4cb-4845-4a8d-92ed-25b240979ac5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'create', calling method: .version_select at 0x7f24bc301310>, body: {"keypair": {"name": "tempest-keypair-105507590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFXKTLMbS0hKpKSkdL2CXxCmhx3bg4S5i8NyLr8yFaNQmulTZ7m6apZrsRZ11AxqXfjefySV9nz1WdxxrDBVfqSTJQKy8WdR9BdIISsusBZS5njZigLcemONkTrtrFnIA=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:29.826890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-453ac4cb-4845-4a8d-92ed-25b240979ac5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for project bcee5099fd2b4df2adaa069af3a45733. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:29.830729 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-453ac4cb-4845-4a8d-92ed-25b240979ac5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for user ee532b08897148dd9ff0482a00f537f7 and project bcee5099fd2b4df2adaa069af3a45733. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:29.856097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-453ac4cb-4845-4a8d-92ed-25b240979ac5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048066 May 12 17:45:29.856623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 227/459] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:45:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:30.109928 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:30.110344 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:30.116629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.117103 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.118179 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.118557 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.133297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:30.134407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:30.141846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.142803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.144009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.144740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.252646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lazy-loading 'services' on Instance uuid c187f64c-8f0e-49e9-af9c-09fcad26bec4 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:30.335111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.345151 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.346930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.348215 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2d4967df-9328-4073-8d94-dfc5efbe79c1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1752 microversion: 2.20 time: 0.220310 May 12 17:45:30.348852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 228/460] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:30 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:30.374034 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3ca30061-267c-4555-b74d-dc86ed817eaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4/os-volume_attachments/1ad46ee8-2b45-47da-941a-4df0bfc8072f" status: 202 len: 0 microversion: 2.1 time: 0.268113 May 12 17:45:30.374846 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 233/461] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:45:30 2022] DELETE /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4/os-volume_attachments/1ad46ee8-2b45-47da-941a-4df0bfc8072f => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:45:30.553485 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:30.554226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:30.560300 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.560755 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.561532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.561975 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.694396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.703344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0daa0179-4db5-48bf-afa3-ed7e239773c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1710 microversion: 2.1 time: 0.153774 May 12 17:45:30.704008 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 229/462] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:30 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:31.261971 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1164695608", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2308c9c-cbd7-48e8-a900-0d956d07aa27"}], "security_groups": [{"name": "tempest-securitygroup--1821487677"}], "key_name": "tempest-keypair-105507590", "user_data": "}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:31.362357 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] validate_networks() for [('c2308c9c-cbd7-48e8-a900-0d956d07aa27', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:45:31.368266 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:31.369029 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:31.375560 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.376015 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.376785 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.377227 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.515741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.525184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.526713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.527910 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-44e14903-614a-40c1-92bf-03feb827dc76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1752 microversion: 2.20 time: 0.163690 May 12 17:45:31.528465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 230/463] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:31 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:31.721645 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:31.722303 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:31.728724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.729179 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.729964 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.730408 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.734933 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:31.735352 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:31.735818 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:31.736223 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:31.736629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:31.746177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.746618 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.747449 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.747962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.765390 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for project bcee5099fd2b4df2adaa069af3a45733. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:31.770621 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Getting quotas for user ee532b08897148dd9ff0482a00f537f7 and project bcee5099fd2b4df2adaa069af3a45733. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:31.782964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:31.785338 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:31.832601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-dd21d410-8312-41a5-9f0f-9ada73d925c4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.575823 May 12 17:45:31.833685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 234/464] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:45:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:45:31.843664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f1b99d1a-dab9-48a7-817c-f1e5b3bc0c2a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:31.844284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f1b99d1a-dab9-48a7-817c-f1e5b3bc0c2a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:31.867774 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.879780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-45c97b7d-a6ab-4889-99f3-5567644bc62f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1710 microversion: 2.1 time: 0.162118 May 12 17:45:31.883647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 231/465] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:31 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:31.902175 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f1b99d1a-dab9-48a7-817c-f1e5b3bc0c2a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.908803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f1b99d1a-dab9-48a7-817c-f1e5b3bc0c2a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1245 microversion: 2.1 time: 0.069137 May 12 17:45:31.909429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 235/466] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:31 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:32.545935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:32.546536 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:32.553054 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.553507 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.554280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.555314 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.736656 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:32.751645 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:32.754503 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:32.756092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0b83bf99-9bc1-41c3-a1e4-dbc882f7cad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1752 microversion: 2.20 time: 0.214049 May 12 17:45:32.756883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 232/467] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:32 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:32.897701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:32.898385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:32.905100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.905557 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.906352 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.906823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.925551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:32.927302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:32.933382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.933918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.934782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.938810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.013263 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.021041 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-000d95b0-8523-48ae-b0a9-03836e9ca2c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1241 microversion: 2.1 time: 0.099329 May 12 17:45:33.021612 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 233/468] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:32 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:33.058544 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.068974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c5a9156b-d57d-4ba1-bb6a-a6a330444e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1710 microversion: 2.1 time: 0.175076 May 12 17:45:33.069920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 236/469] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:32 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:33.779613 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:33.780218 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:33.786605 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.787092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.787890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.788328 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.919635 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.927630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.929116 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.930791 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-64e1a067-9075-4ce7-8282-5c7fab955bf5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1754 microversion: 2.20 time: 0.155052 May 12 17:45:33.931348 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 234/470] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:33 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:34.040867 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.041469 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.048007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.048450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.049216 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.049648 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.089094 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.090002 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.097160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.097621 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.098404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.098878 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.115714 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.123896 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0c8849d4-9636-4be5-80ae-4163b99960c1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1297 microversion: 2.1 time: 0.087727 May 12 17:45:34.124541 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 237/471] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:34.239006 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.248456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-87414d55-6727-423c-a39b-8ac977a6a75e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1714 microversion: 2.1 time: 0.162580 May 12 17:45:34.249833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 235/472] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:34.950106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.951031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.960677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.962332 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.963376 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.964037 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.141827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:35.142433 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:35.152986 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.153446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.154266 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.154732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.237400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.263870 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.269573 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.272799 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ae73f04f-c422-49ae-9aae-88dacd24e57d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1754 microversion: 2.20 time: 0.326685 May 12 17:45:35.275378 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 238/473] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1754 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:35.295991 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.307356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4802b3f3-0af7-4091-aa70-58800fc7c4a2 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1315 microversion: 2.1 time: 0.167493 May 12 17:45:35.310963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 236/474] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:35 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:35.735730 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:35.737102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:35.744282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.744681 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.745513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.745949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.778812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:45:35.876395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-284aefff-b0bd-4c87-b0e2-f957826780a9 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 204 len: 0 microversion: 2.1 time: 0.144450 May 12 17:45:35.877309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 239/475] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:45:35 2022] DELETE /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:45:35.885622 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:35.886562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:35.895580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.896298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.897379 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.897973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.049387 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:36.057330 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-51720423-9fb1-4e66-8470-cfa3fb439c6f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1513 microversion: 2.1 time: 0.175592 May 12 17:45:36.058115 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 237/476] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:35 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:36.299456 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:36.300753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:36.310552 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.311028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.312064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.312716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.328720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:36.329701 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:36.344469 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.345593 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.347432 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.348507 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.654601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:36.667200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:36.669019 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:36.670280 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-95a1cec1-88cf-4433-a556-4dda484a16c8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1754 microversion: 2.20 time: 0.375908 May 12 17:45:36.671148 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 240/477] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:36 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1754 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:36.674208 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:36.687633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-aacb6099-d0c0-4e00-bf0a-8f5fb9349849 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.363346 May 12 17:45:36.688807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 238/478] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:36 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:37.076260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:37.076964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:37.084378 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.084832 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.085772 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.086236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.238060 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.247059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-672d47d7-b52b-4375-b0e3-0d3ceb3f926b tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1513 microversion: 2.1 time: 0.174741 May 12 17:45:37.247630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 241/479] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:37 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:37.688820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:37.689474 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:37.696512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.697027 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.697805 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.698244 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.708829 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:37.710267 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:37.720275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.721074 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.721861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.722366 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.848637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.858326 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.861086 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.862723 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2c307b10-82e0-4097-b355-46b107b08389 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1754 microversion: 2.20 time: 0.177439 May 12 17:45:37.869138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 239/480] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:37 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:37.902210 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.909813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-408a1443-9424-4601-86dd-89a14ca61253 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.207483 May 12 17:45:37.910432 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 242/481] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:37 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:38.265038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.265927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.272449 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.272903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.274264 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.275238 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.409180 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:38.417194 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e660ec59-3e73-428a-9d47-b1c134cebd7f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1513 microversion: 2.1 time: 0.156104 May 12 17:45:38.418697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 240/482] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:38.883118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.883750 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.892726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.894542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.895774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.896413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.938310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.940252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.967442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.967905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.971688 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.973475 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.231558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.246172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.249627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.256015 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-88cd8cc8-3ba1-46aa-bb1d-26e14398bf7f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1754 microversion: 2.20 time: 0.378256 May 12 17:45:39.257448 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 243/483] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1754 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:39.307994 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.320858 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c9eb5a6d-85aa-45a2-b9b6-c1c20257fce7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.388250 May 12 17:45:39.323830 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 241/484] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:39.441432 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:39.442655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:39.467055 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.473442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.476726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.478181 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.543158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-28f06f05-7acf-4fe2-9ce8-36ddc34cebd8 req-88c865ef-5653-4637-94c5-f6e8a75f2e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0424abb5-9a1e-40d7-9293-6afed05d22a4", "tag": "e7bcf6a7-e3d8-42ac-93af-72139b9509fa"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:39.558868 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-28f06f05-7acf-4fe2-9ce8-36ddc34cebd8 req-88c865ef-5653-4637-94c5-f6e8a75f2e55 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.559413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-28f06f05-7acf-4fe2-9ce8-36ddc34cebd8 req-88c865ef-5653-4637-94c5-f6e8a75f2e55 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.598989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-28f06f05-7acf-4fe2-9ce8-36ddc34cebd8 req-88c865ef-5653-4637-94c5-f6e8a75f2e55 service nova] Creating event network-changed:e7bcf6a7-e3d8-42ac-93af-72139b9509fa for instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 on hv-cinder-83979 May 12 17:45:39.618488 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-28f06f05-7acf-4fe2-9ce8-36ddc34cebd8 req-88c865ef-5653-4637-94c5-f6e8a75f2e55 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079811 May 12 17:45:39.628569 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 242/485] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:40.111385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-981bfebc-5d25-4bdf-9a05-cd3c1d24f96b req-cf1b4fff-fd94-43ba-a199-3bc9134f8dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c187f64c-8f0e-49e9-af9c-09fcad26bec4", "name": "network-vif-deleted", "tag": "27eca0e5-f3eb-4a6d-be1d-b05246bdf746"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:40.125240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-981bfebc-5d25-4bdf-9a05-cd3c1d24f96b req-cf1b4fff-fd94-43ba-a199-3bc9134f8dca service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.127398 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-981bfebc-5d25-4bdf-9a05-cd3c1d24f96b req-cf1b4fff-fd94-43ba-a199-3bc9134f8dca service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.142174 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-981bfebc-5d25-4bdf-9a05-cd3c1d24f96b req-cf1b4fff-fd94-43ba-a199-3bc9134f8dca service nova] Creating event network-vif-deleted:27eca0e5-f3eb-4a6d-be1d-b05246bdf746 for instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 on hv-cinder-83979 May 12 17:45:40.155621 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-981bfebc-5d25-4bdf-9a05-cd3c1d24f96b req-cf1b4fff-fd94-43ba-a199-3bc9134f8dca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047379 May 12 17:45:40.162030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 243/486] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:40.172344 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.181591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6b33e42b-5c18-4b95-a2cb-d59a97489f3a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1513 microversion: 2.1 time: 0.749439 May 12 17:45:40.182956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 244/487] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:39 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1513 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:40.279341 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:40.280275 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:40.297163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.297731 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.298791 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.299820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.339895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:40.340784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:40.351824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.354133 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.355576 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.359056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.604545 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.621792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a3e2d69d-17fd-416c-bec0-90da2f57925c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.286606 May 12 17:45:40.622825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 245/488] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:40 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:40.661711 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.671298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.672796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.673985 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3c0f9383-77a1-461d-a28a-37110fcc1aa5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.400360 May 12 17:45:40.674591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 244/489] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:40 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:41.203651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:41.213243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:41.227612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.228491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.229771 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.230452 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.272543 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.273397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.274777 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lazy-loading 'fault' on Instance uuid c187f64c-8f0e-49e9-af9c-09fcad26bec4 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:41.386151 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.408243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c986e57e-173a-4bfc-bae5-f1a6610943c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 200 len: 1309 microversion: 2.1 time: 0.211584 May 12 17:45:41.423046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 246/490] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:41 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:41.641195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:41.642632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:41.651662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.652520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.654228 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.654871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.692402 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:41.693124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:41.707937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.708566 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.709466 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.710025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.837796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.846084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-90ea5290-8c71-483a-b9a8-8f8a21166511 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.209636 May 12 17:45:41.846995 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 245/491] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:41 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:41.866943 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.877604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.879129 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.880276 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-955c762a-4bd0-40dd-a682-75d12dcc6a9b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.191994 May 12 17:45:41.881215 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 247/492] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:41 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:42.426055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:42.426660 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: c187f64c-8f0e-49e9-af9c-09fcad26bec4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:42.433597 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.434280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.435085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.435518 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.449578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] HTTP exception thrown: Instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 could not be found. May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Request method failure captured: May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 HTTP/1.1 May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUdwofnp8wEZYISytiWEeqVXvHt5P-fGVsV6d3_aayNony_Yfc9nyuCpXL-sbIIJ_0sglWa4lM-3MLIJ5SLAKDMWEGwovypI8x-EkU09t3rh7BM6MnQJ4QxqkX5RMYCbFAstbCADza5fNjAG6TBc5PZyyAM-1_OBktNftmu7bEMRZ6E May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 5efa2685b0ca4a4e86626fddbd68e4ed May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2096800864 May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:45:42.451252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5efa2685b0ca4a4e86626fddbd68e4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5efa2685b0ca4a4e86626fddbd68e4ed", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5efa2685b0ca4a4e86626fddbd68e4ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5efa2685b0ca4a4e86626fddbd68e4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-VolumesSnapshotTestJSON-2096800864 May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 5efa2685b0ca4a4e86626fddbd68e4ed May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2096800864 May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-VolumesSnapshotTestJSON-2096800864-project May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 588930f5618c4d7d92de82a89a17d923 May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-VolumesSnapshotTestJSON-2096800864-project May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 could not be found. May 12 17:45:42.452857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'c187f64c-8f0e-49e9-af9c-09fcad26bec4'} May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 could not be found. May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:45:42.453733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 could not be found. May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 could not be found. May 12 17:45:42.454973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:45:42.456104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Returning 404 to user: Instance c187f64c-8f0e-49e9-af9c-09fcad26bec4 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:45:42.456104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e2b780af-70b4-48d1-b464-dcbb5f2103da tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4" status: 404 len: 111 microversion: 2.1 time: 0.030475 May 12 17:45:42.456104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 246/493] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:42 2022] GET /compute/v2.1/servers/c187f64c-8f0e-49e9-af9c-09fcad26bec4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:45:42.865720 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:42.866341 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:42.874711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.875910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.876796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.877743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.900854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:42.901666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:42.908758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.909482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.910445 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.910927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.042088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:43.053917 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-25c600c7-cb25-4a43-bbd6-9494d08cf595 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.191859 May 12 17:45:43.055673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 248/494] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:42 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:43.062950 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:43.078468 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:43.080347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:43.081550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e30c58c3-d26e-4972-84a4-676ac389a7f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.184733 May 12 17:45:43.090104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 247/495] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:42 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:44.074023 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:44.075306 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:44.082190 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.082772 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.083657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.084201 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.100334 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:44.101967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:44.108719 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.109519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.110573 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.111278 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.250852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.259383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-737052ec-6505-4db4-a02c-3e0aa694400d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.190719 May 12 17:45:44.272750 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.275755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 249/496] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:44 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:44.284584 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.286641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.287865 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-27f48d15-9874-454f-8c97-96dabc5e7922 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.191569 May 12 17:45:44.288589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 248/497] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:44 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:45.276457 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:45.277222 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:45.284249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.284796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.285664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.286166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.310511 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:45.313466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:45.324235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.325476 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.327029 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.327860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.482393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.504017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-daf55d93-11b1-4803-9e35-bc4711a56699 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.231536 May 12 17:45:45.505163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 250/498] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:45 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:45.531174 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.540245 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.541732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.542893 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9c8f9a0d-e854-487a-99b9-34c0a630727e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.238926 May 12 17:45:45.543435 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 249/499] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:45 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:46.521351 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:46.522419 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:46.531899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.532466 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.533580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.534440 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.561809 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:46.562384 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:46.579725 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.580272 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.581147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.581664 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.747264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.761152 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e15c22e1-8cd9-48ed-babf-45c04abc02f1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.243968 May 12 17:45:46.762042 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 251/500] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:46 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:46.879608 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.908436 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.912906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.915885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b89f5135-dc7b-44be-85a5-9e9c39fa91b3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.358016 May 12 17:45:46.922799 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 250/501] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:46 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:47.778703 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:47.779323 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:47.791992 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.793600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.795412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.796861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.941363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:47.943041 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:47.954310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.955134 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.956446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.957121 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:48.040534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:48.059697 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a9dec792-25eb-421e-a146-90a1e41f849a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.285367 May 12 17:45:48.070510 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 252/502] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:47 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:48.155977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:48.168369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:48.177217 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:48.179036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-874923d7-d358-4385-9200-49d7aa3f21d2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.241321 May 12 17:45:48.180970 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 251/503] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:47 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:49.078649 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:49.080266 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:49.096250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-c4c5a731-1f64-48fc-b009-fd0bfa04668c req-641dd626-2de2-493c-95fb-04df5210d17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0424abb5-9a1e-40d7-9293-6afed05d22a4", "name": "network-vif-plugged", "status": "completed", "tag": "e7bcf6a7-e3d8-42ac-93af-72139b9509fa"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:49.107713 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.111779 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.114482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.116062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-c4c5a731-1f64-48fc-b009-fd0bfa04668c req-641dd626-2de2-493c-95fb-04df5210d17c service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.116384 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.117513 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-c4c5a731-1f64-48fc-b009-fd0bfa04668c req-641dd626-2de2-493c-95fb-04df5210d17c service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.137944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-c4c5a731-1f64-48fc-b009-fd0bfa04668c req-641dd626-2de2-493c-95fb-04df5210d17c service nova] Creating event network-vif-plugged:e7bcf6a7-e3d8-42ac-93af-72139b9509fa for instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 on hv-cinder-83979 May 12 17:45:49.144371 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-c4c5a731-1f64-48fc-b009-fd0bfa04668c req-641dd626-2de2-493c-95fb-04df5210d17c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052280 May 12 17:45:49.145883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 252/504] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:45:49.208886 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:49.215393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:49.225248 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.231371 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.232447 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.233049 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.372918 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.383467 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c4f8f057-ff59-44f4-a667-55c1d8d2123e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.309288 May 12 17:45:49.396850 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 253/505] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:49 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:49.455637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.464837 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.466982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.468355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5e1ed940-3d80-4cf0-acd7-fe3b32849690 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.274388 May 12 17:45:49.468903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 253/506] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:49 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:50.405447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:50.407438 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:50.420202 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.420948 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.421918 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.422706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.488628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:50.495044 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:50.502375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.503164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.504492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.505158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.588577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:50.602634 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e5a1cc69-d50b-49c3-92b8-700e462ccad7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.204633 May 12 17:45:50.612637 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 254/507] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:50 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:50.717472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:50.728931 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:50.734508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:50.735890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-dd570163-5040-4e56-8f40-10ca6d8c9297 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.252003 May 12 17:45:50.736978 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 254/508] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:50 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:51.621622 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:51.622305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:51.629064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.629768 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.630801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.763317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:51.764791 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:51.772776 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.774771 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.776923 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.777701 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.807348 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:51.828094 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-232b6501-eee0-4b39-ab3b-92795ebdf63a tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.211373 May 12 17:45:51.837385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 255/509] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:51 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:51.944181 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:51.954914 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:51.956636 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:51.958079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d121e92a-9248-4774-964f-52236e4454df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.201546 May 12 17:45:51.970040 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 255/510] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:51 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:52.845123 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:52.847090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:52.855035 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.855808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.856812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.857472 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.978428 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:52.979114 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:52.986514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.987660 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.988626 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.989061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:53.016838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:53.039911 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1c379964-2f86-40b9-a383-b8968355c46d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.196917 May 12 17:45:53.042579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 256/511] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:52 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:53.178347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:53.189456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:53.191350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:53.192913 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7328f5e0-ea50-4e1a-a68f-83eb2d94904b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.219616 May 12 17:45:53.193957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 256/512] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:52 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:53.842938 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-889454934", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "networks": [{"uuid": "06e9bf4a-dfcc-439e-b76a-6285d33f5dcb"}]}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:53.894779 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] validate_networks() for [('06e9bf4a-dfcc-439e-b76a-6285d33f5dcb', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:45:54.058901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:54.060104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:54.066896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.067588 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.068360 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.068824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.210270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:54.219009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-06350435-0579-423b-b51a-580c270574f8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.165275 May 12 17:45:54.229479 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 257/513] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:54 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:54.234335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:54.235252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:54.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.256497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.257277 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.258181 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.266578 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:54.267025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:54.267496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:54.267902 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:54.268310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:54.278491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.278979 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.279787 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.280427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.308418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Getting quotas for project 5efa2685b0ca4a4e86626fddbd68e4ed. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:54.312978 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Getting quotas for user 588930f5618c4d7d92de82a89a17d923 and project 5efa2685b0ca4a4e86626fddbd68e4ed. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:54.323929 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:54.326209 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:54.372580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-717f23c5-986e-4056-9ff5-9f67ca1642cd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533401 May 12 17:45:54.373816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 257/514] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:45:54.383872 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cbfb2bca-77d3-497c-9f72-bbc00fa37ad1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:54.384602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cbfb2bca-77d3-497c-9f72-bbc00fa37ad1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:54.403010 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:54.411719 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:54.415008 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:54.416500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-041366bf-921c-4416-b3f7-a5e2e5374cf7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.186249 May 12 17:45:54.430042 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 258/515] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:54 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:54.448729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cbfb2bca-77d3-497c-9f72-bbc00fa37ad1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:54.455605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cbfb2bca-77d3-497c-9f72-bbc00fa37ad1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1218 microversion: 2.1 time: 0.076225 May 12 17:45:54.456177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 258/516] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:54 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:55.237134 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:55.238349 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:55.247959 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.248765 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.249848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.250285 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.411600 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.418895 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-fcce80cc-7766-4a7f-ab21-8ea4260f3588 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.185458 May 12 17:45:55.419398 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 259/517] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:55 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:55.449172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:55.449782 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:55.456944 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.457403 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.458183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.458626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.473385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:55.474008 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:55.481540 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.482079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.482989 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.483499 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.552385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.560811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1f0499df-ea81-4a0b-82a7-89b0deafbc35 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.091422 May 12 17:45:55.561959 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 260/518] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:55 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:55.594098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.603104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.604628 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.605803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-67336280-d3a5-4d83-882c-d93223d2a166 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.161796 May 12 17:45:55.606360 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 259/519] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:55 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:56.435642 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:56.436260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:56.442552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.443042 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.443824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.444265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.579054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:56.579708 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:56.588933 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.589684 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.590772 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.591372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.706912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:56.720810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-85cb559e-1e59-420a-a897-f182523f0e1a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.146290 May 12 17:45:56.730476 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 260/520] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:56 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:56.736534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:56.739255 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:56.746185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.746636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.747468 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.756354 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.886661 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:56.895009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f6791cda-f23d-4ea8-a590-a5adfd26bd6c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.463809 May 12 17:45:56.895888 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 261/521] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:56 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:56.997744 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:57.005092 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:57.006820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:57.008280 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-27fa4fe0-b703-41e7-b08f-c8fd018e05fd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.276668 May 12 17:45:57.009264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 261/522] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:56 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:57.738351 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:57.739058 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:57.745771 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.746361 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.747335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.747832 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.815395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:57.823416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0dacd02d-ba5d-4e54-b6ab-366433b8f86e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.088757 May 12 17:45:57.824594 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 262/523] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:57 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:57.912002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:57.912623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:57.920629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.921077 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.921847 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.922279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.029273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:58.029273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:58.035275 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.035936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.036784 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.037279 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.122765 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:58.136869 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5e5aceb6-9d0e-49b8-ba78-c04cb103db89 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.228506 May 12 17:45:58.138220 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 262/524] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:57 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:58.190277 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:58.200192 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:58.201696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:58.202860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2be25705-4ea6-403d-98c1-d2da9c196a86 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.180571 May 12 17:45:58.203418 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 263/525] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:58 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:58.841864 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:58.842867 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:58.851588 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.852208 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.853182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.853765 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.919428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:58.929224 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-99669c65-374d-4847-b87a-d59b5e791683 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.092198 May 12 17:45:58.930200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 263/526] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:58 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:59.158576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:59.159872 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:59.168090 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.169740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:59.170760 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.172062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:59.223877 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:59.225002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:59.233185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.239294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:59.240836 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.241347 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:59.361436 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:59.369544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c0dba81e-61a9-49e6-82f2-8662df20fd4e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.217330 May 12 17:45:59.370894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 264/527] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:59 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:59.514355 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:59.523437 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:59.525751 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:59.527303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3a00e159-85cf-43da-bd87-379fea9fa163 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.308536 May 12 17:45:59.528053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 264/528] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:45:59 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:59.965285 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:59.965588 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:59.972595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.973146 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:59.974556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.975262 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.052978 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:00.061192 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-44fe6654-7d3a-423b-9197-533139db9e87 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.112971 May 12 17:46:00.061849 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 265/529] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:45:59 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:00.387515 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:00.388106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:00.395228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.396065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.397009 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.397522 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.546204 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:00.548076 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:00.557973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.558464 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.559274 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.574769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.764038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:00.773950 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:00.777290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:00.778251 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4ea857f5-9c38-4437-a446-5d956dbfc703 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.236053 May 12 17:46:00.780919 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 266/530] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:00 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:00.932033 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:00.941482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a2624a64-137c-4564-9a11-c08a21392fae tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.557307 May 12 17:46:00.951994 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 265/531] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:00 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:01.081268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:01.081901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:01.088950 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.089410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.090465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.090956 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.184731 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:01.192140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-42705a9a-479b-4212-b7f5-3af35d9d159e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.115485 May 12 17:46:01.193722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 267/532] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:01 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:01.798069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:01.799053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:01.805713 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.806322 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.807358 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.807797 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.958412 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:01.959047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:01.976817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.977369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.978760 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.979329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.033777 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:02.047556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:02.061536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:02.065753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6cedf56b-3d71-40a7-80c2-01d78ef51b20 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.268931 May 12 17:46:02.078279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 266/533] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:01 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:02.188962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:02.198139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-23458cc3-9a15-4358-bfd4-04ffcfa7481d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.244624 May 12 17:46:02.199274 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 268/534] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:01 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:02.210615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:02.211247 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:02.219814 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.220513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.221559 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.222216 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.385413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:02.393871 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c5f553a5-e8fa-4434-92d4-c4f735073ea7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.186959 May 12 17:46:02.395479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 267/535] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:02 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:03.089402 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:03.105480 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:03.116610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.117309 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.118493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.119245 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.217287 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:03.219143 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:03.225843 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.247460 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.251313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.251924 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.308107 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:03.325318 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:03.331291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:03.332763 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ff0a1065-bff0-4a24-820b-416cbbbc6f89 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.248703 May 12 17:46:03.334131 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 269/536] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:03 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:03.413168 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:03.413819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:03.423643 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.424356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.425331 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.425773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.493195 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:03.515594 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:03.521119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f5db46c3-f688-4df0-87ff-0b4b794aa324 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.310111 May 12 17:46:03.523904 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-777933e1-6f8e-4192-92c1-d9099b45396d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.114937 May 12 17:46:03.535050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 270/537] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:03 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:03.536049 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 268/538] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:03 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:04.353752 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:04.354254 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:04.361093 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.361551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.362478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.363201 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.515452 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:04.529226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:04.530855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:04.532028 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a688fc6b-c974-4989-a5e0-bf17a2c9c296 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.183583 May 12 17:46:04.532582 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 271/539] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:04 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:04.551134 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:04.551747 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:04.558173 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:04.558815 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:04.559478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.559944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.565009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.565488 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.567383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.567821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.568597 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.573496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.654079 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:04.662073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d482b3f3-f694-483f-b895-54abedc9b24d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.116625 May 12 17:46:04.662746 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 269/540] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:04 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:04.734311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:04.742572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0fddb033-0eb9-4144-ab6f-3776b6dd4692 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.195176 May 12 17:46:04.743781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 272/541] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:04 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:05.553364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:05.554059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:05.561264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.561906 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.562753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.563288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.679880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:05.683225 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:05.694906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.695921 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.698429 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.699153 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.781721 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:05.794785 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0f1b103d-ddb7-447b-9b9b-c463b4633d22 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1222 microversion: 2.1 time: 0.115390 May 12 17:46:05.796073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 273/542] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:05 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:05.803648 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:05.804768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:05.813921 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.815166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.815755 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.816294 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.010906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.043160 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.054569 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-34d402fb-896c-4fb7-b790-2c7881b5d1d0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.252867 May 12 17:46:06.056558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 274/543] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:05 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:06.059065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.061022 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.062430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1abbf7e9-c84d-4f2e-9475-af9698bfe91e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.513163 May 12 17:46:06.063555 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 270/544] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:05 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:06.813640 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:06.814885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:06.824413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:06.828697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.829922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:06.831893 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.933035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.945765 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-32a1feea-fb89-425d-93f7-7e67bf34f815 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1270 microversion: 2.1 time: 0.137156 May 12 17:46:06.948765 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 275/545] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:06 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:07.073185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:07.074108 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:07.081731 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:07.082456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:07.084139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.085119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.086515 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.087212 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.095882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.099224 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.102195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.105595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.381231 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:07.396542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cfa5d722-b4ba-4404-a82c-1d69b16cefd5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1371 microversion: 2.1 time: 0.327815 May 12 17:46:07.397446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 271/546] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:07 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:07.417933 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:07.429065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:07.431910 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:07.433634 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5fa0f85e-3002-4ae0-a840-718c1b5d04df tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.356070 May 12 17:46:07.434443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 276/547] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:07 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:46:07.966445 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:07.975504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:07.987289 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.989927 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.996618 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.999612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.145459 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.166635 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-479fa3b2-2af9-4171-9dec-d2d176daaf26 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1276 microversion: 2.1 time: 0.195658 May 12 17:46:08.168251 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 272/548] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:07 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:08.417288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:08.418047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:08.434461 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.434945 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.435736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.436179 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.452911 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:08.453911 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:08.464028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.466868 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.467921 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.473614 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.683478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.694099 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.699448 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.710707 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fb019195-5d5d-4510-8bad-43be0997ccc1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.262405 May 12 17:46:08.716930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 273/549] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:08 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:46:08.911661 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.920196 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-449d24d5-8cd9-49f3-8472-8eb7b11c2d99 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1563 microversion: 2.1 time: 0.507818 May 12 17:46:08.921034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 277/550] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:08 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1563 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:08.937835 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-17621547-278e-4f3d-a3e2-0289a892fa52 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:08.938806 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-17621547-278e-4f3d-a3e2-0289a892fa52 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:08.945189 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17621547-278e-4f3d-a3e2-0289a892fa52 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.945649 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17621547-278e-4f3d-a3e2-0289a892fa52 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.946962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17621547-278e-4f3d-a3e2-0289a892fa52 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.947666 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17621547-278e-4f3d-a3e2-0289a892fa52 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.073189 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-17621547-278e-4f3d-a3e2-0289a892fa52 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139256 May 12 17:46:09.082377 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 274/551] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:46:08 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:09.185278 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:09.187137 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:09.193807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.194510 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.195491 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.196085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.531007 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:09.543237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-204ae12a-addb-4e3d-83ee-7d8e3de5e1c6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.362315 May 12 17:46:09.557577 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 278/552] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:09 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:09.736716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:09.738534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:09.746721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.747521 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.748615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.749279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.059495 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:10.071401 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:10.075617 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:10.080730 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1fcaa4fa-93d3-4283-86bb-9a4f2647cd82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.348387 May 12 17:46:10.082883 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 275/553] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:09 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:10.438271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-dae195ff-9a10-42ae-b69f-d9515abe91d9 req-dcb23150-88c0-4225-b29b-1f93c4c67831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0424abb5-9a1e-40d7-9293-6afed05d22a4", "tag": "e7bcf6a7-e3d8-42ac-93af-72139b9509fa"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:10.454830 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-dae195ff-9a10-42ae-b69f-d9515abe91d9 req-dcb23150-88c0-4225-b29b-1f93c4c67831 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.459542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-dae195ff-9a10-42ae-b69f-d9515abe91d9 req-dcb23150-88c0-4225-b29b-1f93c4c67831 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.474253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-dae195ff-9a10-42ae-b69f-d9515abe91d9 req-dcb23150-88c0-4225-b29b-1f93c4c67831 service nova] Creating event network-changed:e7bcf6a7-e3d8-42ac-93af-72139b9509fa for instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 on hv-cinder-83979 May 12 17:46:10.481994 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-dae195ff-9a10-42ae-b69f-d9515abe91d9 req-dcb23150-88c0-4225-b29b-1f93c4c67831 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047269 May 12 17:46:10.487472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 279/554] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:10.562116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:10.562967 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:10.570698 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.572538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.573760 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.574558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.736140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:10.745886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4b1e4175-9cfe-4fde-88dd-592634afc5d6 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.187457 May 12 17:46:10.746487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 276/555] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:10 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:11.049263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-d6396dc2-061a-48f4-ba27-21cee8852a64 req-1376475e-c1ba-412a-b53f-b41f62629b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8049559-bf00-4160-8e46-9a2d0a910c1a", "tag": "6a3e3572-f068-4297-9d91-839b7beaff17"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:11.059487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d6396dc2-061a-48f4-ba27-21cee8852a64 req-1376475e-c1ba-412a-b53f-b41f62629b75 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.060241 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d6396dc2-061a-48f4-ba27-21cee8852a64 req-1376475e-c1ba-412a-b53f-b41f62629b75 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.072495 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-d6396dc2-061a-48f4-ba27-21cee8852a64 req-1376475e-c1ba-412a-b53f-b41f62629b75 service nova] Creating event network-changed:6a3e3572-f068-4297-9d91-839b7beaff17 for instance a8049559-bf00-4160-8e46-9a2d0a910c1a on hv-cinder-83979 May 12 17:46:11.078340 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-d6396dc2-061a-48f4-ba27-21cee8852a64 req-1376475e-c1ba-412a-b53f-b41f62629b75 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032711 May 12 17:46:11.079293 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 277/556] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:46:11.104055 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:11.104928 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:11.112261 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.112715 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.113538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.113984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.235710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f22fd163-5074-488a-9fa6-d2cac64e2afd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Action: 'create', calling method: .version_select at 0x7f24bc34b8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2097308627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMFDccq52/oism59dwNtGxTmu2kZBN52fJstKrtUEfBSO0wlqnIeKcJLKH4oEuxc6y+DPTa2YQRoDktNjgk3TQRyvnBBjdb/Hv0uu6EWX1qgB84NKhIuJD9Q8EIRBE64w=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:11.251609 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-f22fd163-5074-488a-9fa6-d2cac64e2afd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Getting quotas for project 667ee24fd13d4432a040a745bf2a0d0e. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:46:11.255722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-f22fd163-5074-488a-9fa6-d2cac64e2afd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Getting quotas for user 2afcd57a10c14963acd187bd2aabb229 and project 667ee24fd13d4432a040a745bf2a0d0e. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:46:11.282386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f22fd163-5074-488a-9fa6-d2cac64e2afd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.261866 May 12 17:46:11.283515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 280/557] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:46:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:11.284975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:11.293734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:11.295278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:11.296433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f8d08d1f-c8ef-4e81-ac31-37dbd203d298 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.199080 May 12 17:46:11.296993 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 278/558] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:11 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:11.764010 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:11.765100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:11.773345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.774282 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.776286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.777102 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.985267 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:11.997080 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e34f0c73-b64b-4d21-9a90-1855e05454b7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.237068 May 12 17:46:11.998761 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 281/559] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:11 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:12.315958 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:12.316627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:12.323696 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.324011 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.325132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.325727 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.541881 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:12.557025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:12.566293 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:12.569585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-bc34f4b6-97ad-43d1-94be-ce869d844be5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.257592 May 12 17:46:12.580297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 279/560] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:12 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:13.018746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:13.023050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:13.039363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.040833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.042883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.043545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.289581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:13.298727 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-02fff1fc-55ce-4c6d-ad89-61d11bf8b9c8 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.286752 May 12 17:46:13.309519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 282/561] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:13 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:13.589293 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:13.590025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:13.597861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.598220 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.599126 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.599620 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.736081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:13.744975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:13.746502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:13.747711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2bde75cb-e0bd-4d4c-a398-69f357f6302a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.163373 May 12 17:46:13.748269 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 280/562] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:13 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:14.316458 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:14.317058 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:14.324220 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.324670 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:14.325446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.325881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:14.459378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:14.466629 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7f716221-b873-4073-acd3-efc7c6763651 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.154044 May 12 17:46:14.467224 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 283/563] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:14 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:14.765943 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:14.766551 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:14.773065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.773518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:14.774533 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.775653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:14.904386 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:14.912652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:14.914160 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:14.915532 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-12878aba-cd4f-427c-a4dc-685596c77291 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.153641 May 12 17:46:14.916120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 281/564] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:14 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:15.296012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-f8f3799f-dd6a-4619-b169-2c348a4731f4 req-44f75fe8-9c8a-436b-8a20-5042438c3c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b3f033-5f36-4355-8221-ab55bcba8722", "name": "network-vif-plugged", "status": "completed", "tag": "20f0b51d-9edf-437d-a233-3e26daa2ef7c"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:15.305581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f8f3799f-dd6a-4619-b169-2c348a4731f4 req-44f75fe8-9c8a-436b-8a20-5042438c3c0d service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.306302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f8f3799f-dd6a-4619-b169-2c348a4731f4 req-44f75fe8-9c8a-436b-8a20-5042438c3c0d service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.318370 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-f8f3799f-dd6a-4619-b169-2c348a4731f4 req-44f75fe8-9c8a-436b-8a20-5042438c3c0d service nova] Creating event network-vif-plugged:20f0b51d-9edf-437d-a233-3e26daa2ef7c for instance 12b3f033-5f36-4355-8221-ab55bcba8722 on hv-cinder-83979 May 12 17:46:15.323689 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-f8f3799f-dd6a-4619-b169-2c348a4731f4 req-44f75fe8-9c8a-436b-8a20-5042438c3c0d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031933 May 12 17:46:15.324631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 284/565] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:15.483549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:15.484571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:15.491191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.491653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.492458 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.492920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.640583 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:15.648475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-34892c26-40b2-4451-afef-fab6de7ca1c1 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.168793 May 12 17:46:15.649080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 282/566] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:15 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:15.935646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:15.936411 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:15.942606 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.943079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.943840 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.944301 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.124658 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:16.132901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:16.134405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:16.135840 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1b724dff-ea5f-4043-82c0-62b5bd67a427 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.205638 May 12 17:46:16.136387 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 285/567] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:15 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:46:16.665191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:16.665795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:16.672203 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.672654 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.673421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.673858 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.802942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:16.810984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4f5c2ea5-2a5b-4433-a3c4-be72f60afc90 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.149673 May 12 17:46:16.811554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 283/568] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:16 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:17.154181 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:17.154828 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:17.161146 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.161590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.162352 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.162810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.292559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:17.300887 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:17.302711 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:17.304000 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-24c9a616-cdc8-4a75-87b6-23874e7c176c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.154341 May 12 17:46:17.304876 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 286/569] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:17 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:17.827758 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:17.828382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:17.834518 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.834995 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.835775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.836216 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.969051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:17.976486 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5284f75d-d4a6-486c-9b22-616cb6d1d6e2 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.152694 May 12 17:46:17.977081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 284/570] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:17 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:18.323283 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:18.324024 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:18.330209 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:18.330691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:18.331475 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:18.331917 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:18.469016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:18.477294 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:18.478874 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:18.483215 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6bafe680-b102-4e84-b556-380ad4a420ac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1810 microversion: 2.20 time: 0.164269 May 12 17:46:18.493575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 287/571] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:18 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:18.993686 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:18.994216 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:19.001325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.001781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.002550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.003017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.131633 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:19.139923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2e7aea55-a45a-498c-97b9-9362d08f8877 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.150211 May 12 17:46:19.140856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 285/572] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:18 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:19.501988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:19.502594 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:19.508995 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.509443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.511047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.511576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.640505 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:19.648940 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:19.650440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:19.651685 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9f6e8915-6461-4c96-bf21-4615db761536 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1797 microversion: 2.20 time: 0.153609 May 12 17:46:19.652251 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 288/573] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:46:19 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:19.849826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-ac5970b3-c730-4b96-9702-cfae8f3cb6f6 req-e537457f-6061-438d-a95f-42d03a9b8a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8049559-bf00-4160-8e46-9a2d0a910c1a", "name": "network-vif-plugged", "status": "completed", "tag": "6a3e3572-f068-4297-9d91-839b7beaff17"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:19.858393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ac5970b3-c730-4b96-9702-cfae8f3cb6f6 req-e537457f-6061-438d-a95f-42d03a9b8a8e service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.858896 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ac5970b3-c730-4b96-9702-cfae8f3cb6f6 req-e537457f-6061-438d-a95f-42d03a9b8a8e service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.870602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-ac5970b3-c730-4b96-9702-cfae8f3cb6f6 req-e537457f-6061-438d-a95f-42d03a9b8a8e service nova] Creating event network-vif-plugged:6a3e3572-f068-4297-9d91-839b7beaff17 for instance a8049559-bf00-4160-8e46-9a2d0a910c1a on hv-cinder-83979 May 12 17:46:19.875665 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-ac5970b3-c730-4b96-9702-cfae8f3cb6f6 req-e537457f-6061-438d-a95f-42d03a9b8a8e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029468 May 12 17:46:19.876263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 286/574] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:20.157793 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:20.158511 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:20.164428 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:20.164868 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:20.165621 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:20.166047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:20.296536 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:20.303755 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-72fa64d5-dadc-48c2-a66d-068f568ff31d tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.149921 May 12 17:46:20.304310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 289/575] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:20 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:21.321757 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:21.322450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:21.329807 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:21.330250 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:21.331030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:21.331460 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:21.459867 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:21.467407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f2b81182-e18d-48e1-8b04-37836c5704f4 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.150249 May 12 17:46:21.468106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 287/576] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:21 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:22.485775 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:22.486295 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:22.492681 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:22.493137 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:22.493950 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:22.494413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:22.629023 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:22.637038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5cb57213-7827-42fc-86c9-4d09967a9cbd tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1318 microversion: 2.1 time: 0.155171 May 12 17:46:22.637715 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 290/577] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:22 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:23.654524 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:23.655408 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:23.662636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.663318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:23.664216 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.664653 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:23.799695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:23.807061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ce01336b-1ea9-43b6-9bbf-76355be9baaf tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1507 microversion: 2.1 time: 0.157069 May 12 17:46:23.807623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 288/578] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:23 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:23.823822 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c909b9de-48fc-4864-8e6f-21a455d3a30a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6694872f-7edd-4f2f-bcb8-54d002e2b0ed", "device": "/dev/sdb"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:23.825591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c909b9de-48fc-4864-8e6f-21a455d3a30a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:23.831922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c909b9de-48fc-4864-8e6f-21a455d3a30a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.832376 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c909b9de-48fc-4864-8e6f-21a455d3a30a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:23.833145 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c909b9de-48fc-4864-8e6f-21a455d3a30a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.833581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c909b9de-48fc-4864-8e6f-21a455d3a30a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:24.257869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c909b9de-48fc-4864-8e6f-21a455d3a30a tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "POST /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437761 May 12 17:46:24.258466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 291/579] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:46:23 2022] POST /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:26.723740 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-70e8037a-3df0-423f-b0de-ca4f2bb65d0a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.724261 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-70e8037a-3df0-423f-b0de-ca4f2bb65d0a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:26.730450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70e8037a-3df0-423f-b0de-ca4f2bb65d0a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.731540 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70e8037a-3df0-423f-b0de-ca4f2bb65d0a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.732393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70e8037a-3df0-423f-b0de-ca4f2bb65d0a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.732832 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70e8037a-3df0-423f-b0de-ca4f2bb65d0a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.755361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-70e8037a-3df0-423f-b0de-ca4f2bb65d0a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725/ips" status: 200 len: 150 microversion: 2.1 time: 0.035662 May 12 17:46:26.755914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 289/580] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:26.767190 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03264093-de87-4565-b871-cf629c92da97"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:26.768551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:26.775085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.775481 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.776530 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.777026 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.859350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Invalid volume: volume 03264093-de87-4565-b871-cf629c92da97 is already attached to instances: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: POST /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725/os-volume_attachments HTTP/1.1 May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 74 May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:46:26.861813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {"volumeAttachment": {"volumeId": "03264093-de87-4565-b871-cf629c92da97"}} May 12 17:46:26.863206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Invalid volume: volume 03264093-de87-4565-b871-cf629c92da97 is already attached to instances: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'server_id': '05a5023a-5da1-4a91-a0ad-0775ff136725', 'body': {'volumeAttachment': {'volumeId': '03264093-de87-4565-b871-cf629c92da97'}}} May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03264093-de87-4565-b871-cf629c92da97 is already attached to instances: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:26.863962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03264093-de87-4565-b871-cf629c92da97 is already attached to instances: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:26.865170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03264093-de87-4565-b871-cf629c92da97 is already attached to instances: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 400 to user: Invalid volume: volume 03264093-de87-4565-b871-cf629c92da97 is already attached to instances: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0653712f-47db-4b6e-99d5-f5197ae8bfd2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101028 May 12 17:46:26.866347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 292/581] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:46:26 2022] POST /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:46:26.874055 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.874762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:26.881851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.882378 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.883303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.883838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.910608 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:46:26.987230 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e4bc6021-ca6b-4cbe-9ac8-d5c93bc47857 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 204 len: 0 microversion: 2.1 time: 0.118165 May 12 17:46:26.987824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 290/582] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:46:26 2022] DELETE /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:46:26.997149 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.997900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:27.004677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:27.005134 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:27.005910 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:27.006350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:27.141073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:27.148662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b454880d-f94c-4b71-b99e-f7f97cc7b2f0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1678 microversion: 2.1 time: 0.155657 May 12 17:46:27.149283 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 293/583] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:28.167552 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:28.168278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:28.175554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:28.176024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:28.176808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:28.177250 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:28.308599 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:28.316556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5cc79e34-3b91-4799-a7ce-82fde4eaa388 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1678 microversion: 2.1 time: 0.153838 May 12 17:46:28.317125 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 291/584] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:28 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:29.334653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:29.335429 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:29.342576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:29.343055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:29.343830 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:29.344270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:29.478121 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:29.485980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6b38ee7a-dd77-48ab-b71d-9825d77331a2 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1678 microversion: 2.1 time: 0.155236 May 12 17:46:29.486530 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 294/585] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:29 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:30.502779 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:30.503404 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:30.510019 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.510471 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.511297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.511732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.659737 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:30.667387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-58c1b3b5-6b72-44db-968d-51c6e5f43f49 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1678 microversion: 2.1 time: 0.168484 May 12 17:46:30.667959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 292/586] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:30 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:31.198329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-54c6c790-948a-4ab7-a2fd-4cfa046b1a41 req-530a641d-06ba-4629-a562-1b0b334a6f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a5023a-5da1-4a91-a0ad-0775ff136725", "name": "network-vif-deleted", "tag": "26a87193-d1d2-4c6e-ba24-c895c9893c18"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:31.227526 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-54c6c790-948a-4ab7-a2fd-4cfa046b1a41 req-530a641d-06ba-4629-a562-1b0b334a6f4a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:31.227976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-54c6c790-948a-4ab7-a2fd-4cfa046b1a41 req-530a641d-06ba-4629-a562-1b0b334a6f4a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:31.259653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-54c6c790-948a-4ab7-a2fd-4cfa046b1a41 req-530a641d-06ba-4629-a562-1b0b334a6f4a service nova] Creating event network-vif-deleted:26a87193-d1d2-4c6e-ba24-c895c9893c18 for instance 05a5023a-5da1-4a91-a0ad-0775ff136725 on hv-cinder-83979 May 12 17:46:31.271014 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-54c6c790-948a-4ab7-a2fd-4cfa046b1a41 req-530a641d-06ba-4629-a562-1b0b334a6f4a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076526 May 12 17:46:31.271812 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 295/587] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:31.685897 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:31.686538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:31.694149 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:31.694914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:31.695855 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:31.696455 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:31.732180 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:31.732469 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:31.732838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lazy-loading 'fault' on Instance uuid 05a5023a-5da1-4a91-a0ad-0775ff136725 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:31.773970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:31.783152 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2769a27d-5c2e-48b1-8a5c-3c13d8554905 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 200 len: 1328 microversion: 2.1 time: 0.101546 May 12 17:46:31.783995 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 293/588] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:31 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:32.801466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:32.802337 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:32.810995 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:32.811552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:32.812442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:32.812991 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:32.829531 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 HTTP/1.1 May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:46:32.831375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:46:32.832905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '05a5023a-5da1-4a91-a0ad-0775ff136725'} May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:32.833773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:46:32.835157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:32.836378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:32.836378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f9bbd48e-d3cc-4627-a855-c35167a19b93 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 404 len: 111 microversion: 2.1 time: 0.037317 May 12 17:46:32.839603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 296/589] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:32 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:32.845348 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ea573839-7d25-47c8-be14-56e07789010b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '.version_select at 0x7f24bc144b80>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:32.864737 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ea573839-7d25-47c8-be14-56e07789010b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-9759578" status: 202 len: 0 microversion: 2.1 time: 0.024117 May 12 17:46:32.865905 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 294/590] 10.222.0.76 () {58 vars in 1211 bytes} [Thu May 12 17:46:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-9759578 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:46:33.837222 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:33.837733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:33.844825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.845276 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.846041 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.846501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.968717 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lazy-loading 'services' on Instance uuid 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:34.080982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8d4431b4-ff73-483c-bfa3-adf531835a91 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments/03264093-de87-4565-b871-cf629c92da97" status: 202 len: 0 microversion: 2.1 time: 0.247416 May 12 17:46:34.081609 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 297/591] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:46:33 2022] DELETE /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments/03264093-de87-4565-b871-cf629c92da97 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:46:34.091005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-206c7262-0df1-4ae5-aa29-efaf227a4abb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:34.091949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-206c7262-0df1-4ae5-aa29-efaf227a4abb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:34.100673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-206c7262-0df1-4ae5-aa29-efaf227a4abb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.101121 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-206c7262-0df1-4ae5-aa29-efaf227a4abb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.101889 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-206c7262-0df1-4ae5-aa29-efaf227a4abb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.102322 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-206c7262-0df1-4ae5-aa29-efaf227a4abb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.132502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-206c7262-0df1-4ae5-aa29-efaf227a4abb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046375 May 12 17:46:34.133053 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 295/592] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:34 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:35.146281 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-22af2c11-29ea-4e76-a4bf-37502501408c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:35.147428 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-22af2c11-29ea-4e76-a4bf-37502501408c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:35.154701 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22af2c11-29ea-4e76-a4bf-37502501408c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.155181 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22af2c11-29ea-4e76-a4bf-37502501408c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.156041 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22af2c11-29ea-4e76-a4bf-37502501408c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.156475 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22af2c11-29ea-4e76-a4bf-37502501408c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.185374 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-22af2c11-29ea-4e76-a4bf-37502501408c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 May 12 17:46:35.185931 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 298/593] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:35 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:36.197095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e8e5c71d-8e91-4f18-b686-ad3c3dd32059 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:36.198046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e8e5c71d-8e91-4f18-b686-ad3c3dd32059 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:36.206140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e8e5c71d-8e91-4f18-b686-ad3c3dd32059 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:36.206598 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e8e5c71d-8e91-4f18-b686-ad3c3dd32059 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:36.208162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e8e5c71d-8e91-4f18-b686-ad3c3dd32059 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:36.208605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e8e5c71d-8e91-4f18-b686-ad3c3dd32059 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:36.240413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e8e5c71d-8e91-4f18-b686-ad3c3dd32059 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046915 May 12 17:46:36.240563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 296/594] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:36 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:37.251693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d429ebab-4859-4cab-875b-5933fe468c3c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:37.252707 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d429ebab-4859-4cab-875b-5933fe468c3c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:37.258985 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d429ebab-4859-4cab-875b-5933fe468c3c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.259441 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d429ebab-4859-4cab-875b-5933fe468c3c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.260213 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d429ebab-4859-4cab-875b-5933fe468c3c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.260653 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d429ebab-4859-4cab-875b-5933fe468c3c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.293478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d429ebab-4859-4cab-875b-5933fe468c3c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 May 12 17:46:37.294065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 299/595] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:37 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:38.304512 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9d1ac6f0-91bf-42b3-8787-54ce1bec5640 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:38.305763 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9d1ac6f0-91bf-42b3-8787-54ce1bec5640 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:38.313636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d1ac6f0-91bf-42b3-8787-54ce1bec5640 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.314173 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d1ac6f0-91bf-42b3-8787-54ce1bec5640 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.315338 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d1ac6f0-91bf-42b3-8787-54ce1bec5640 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.316258 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d1ac6f0-91bf-42b3-8787-54ce1bec5640 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.351166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9d1ac6f0-91bf-42b3-8787-54ce1bec5640 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050826 May 12 17:46:38.351732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 297/596] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:38 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:39.363271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2afbcdbf-0d42-47fd-b597-e6719a5628b3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:39.364190 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2afbcdbf-0d42-47fd-b597-e6719a5628b3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:39.370470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2afbcdbf-0d42-47fd-b597-e6719a5628b3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.370970 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2afbcdbf-0d42-47fd-b597-e6719a5628b3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:39.372602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2afbcdbf-0d42-47fd-b597-e6719a5628b3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.373043 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2afbcdbf-0d42-47fd-b597-e6719a5628b3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:39.401139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2afbcdbf-0d42-47fd-b597-e6719a5628b3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041802 May 12 17:46:39.401679 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 300/597] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:39 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:40.412801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-20ee30a7-bab5-41b5-b830-605a29286576 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:40.413699 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-20ee30a7-bab5-41b5-b830-605a29286576 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:40.420549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-20ee30a7-bab5-41b5-b830-605a29286576 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:40.420988 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-20ee30a7-bab5-41b5-b830-605a29286576 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.421743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-20ee30a7-bab5-41b5-b830-605a29286576 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:40.422168 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-20ee30a7-bab5-41b5-b830-605a29286576 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.452491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-20ee30a7-bab5-41b5-b830-605a29286576 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 May 12 17:46:40.453257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 298/598] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:40 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:41.464128 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8a0accba-382b-485c-86bf-5c7f7a5feddd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:41.465552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8a0accba-382b-485c-86bf-5c7f7a5feddd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:41.472434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a0accba-382b-485c-86bf-5c7f7a5feddd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.472885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a0accba-382b-485c-86bf-5c7f7a5feddd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:41.473646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a0accba-382b-485c-86bf-5c7f7a5feddd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.474094 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8a0accba-382b-485c-86bf-5c7f7a5feddd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:41.507603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8a0accba-382b-485c-86bf-5c7f7a5feddd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047322 May 12 17:46:41.508081 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 301/599] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:41 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:42.519108 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9d4947bc-eb11-41c0-bb96-5589e52414d7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:42.520288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9d4947bc-eb11-41c0-bb96-5589e52414d7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:42.526537 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d4947bc-eb11-41c0-bb96-5589e52414d7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:42.527027 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d4947bc-eb11-41c0-bb96-5589e52414d7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:42.527793 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d4947bc-eb11-41c0-bb96-5589e52414d7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:42.528232 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9d4947bc-eb11-41c0-bb96-5589e52414d7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:42.562579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9d4947bc-eb11-41c0-bb96-5589e52414d7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047350 May 12 17:46:42.563311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 299/600] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:42 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:43.575472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-625dcd03-128e-44c6-be74-ba766fb49c66 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:43.576492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-625dcd03-128e-44c6-be74-ba766fb49c66 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:43.582874 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-625dcd03-128e-44c6-be74-ba766fb49c66 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:43.583329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-625dcd03-128e-44c6-be74-ba766fb49c66 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:43.584112 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-625dcd03-128e-44c6-be74-ba766fb49c66 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:43.584538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-625dcd03-128e-44c6-be74-ba766fb49c66 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:43.614031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-625dcd03-128e-44c6-be74-ba766fb49c66 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042452 May 12 17:46:43.614605 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 302/601] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:43 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:46:44.626251 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cf0453eb-8fcb-4c2a-95a2-de863bc29e11 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:44.627184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cf0453eb-8fcb-4c2a-95a2-de863bc29e11 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:44.633453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cf0453eb-8fcb-4c2a-95a2-de863bc29e11 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.633899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cf0453eb-8fcb-4c2a-95a2-de863bc29e11 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.634706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cf0453eb-8fcb-4c2a-95a2-de863bc29e11 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.635145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cf0453eb-8fcb-4c2a-95a2-de863bc29e11 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.663584 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cf0453eb-8fcb-4c2a-95a2-de863bc29e11 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042091 May 12 17:46:44.664133 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 300/602] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:44 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:45.675184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-514865b7-1eaf-49d8-b991-4518ec89f6b0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:45.676268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-514865b7-1eaf-49d8-b991-4518ec89f6b0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:45.682601 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-514865b7-1eaf-49d8-b991-4518ec89f6b0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.683085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-514865b7-1eaf-49d8-b991-4518ec89f6b0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.683860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-514865b7-1eaf-49d8-b991-4518ec89f6b0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.684297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-514865b7-1eaf-49d8-b991-4518ec89f6b0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.712749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-514865b7-1eaf-49d8-b991-4518ec89f6b0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041703 May 12 17:46:45.713326 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 303/603] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:46:45 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:46:45.769633 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:45.770394 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:45.776619 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.777210 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.778093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.778634 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.803779 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:46:45.879275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8243630f-4131-4b53-acf3-573ca91739ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 204 len: 0 microversion: 2.1 time: 0.112964 May 12 17:46:45.879819 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 301/604] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:46:45 2022] DELETE /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:46:45.888570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:45.889350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:45.895468 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.895925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.896697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.897132 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.267572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:46.275230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4f719311-4a5d-46c1-914a-896e587057f7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1683 microversion: 2.1 time: 0.390867 May 12 17:46:46.275801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 304/605] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:45 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1683 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:47.292919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:47.293622 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:47.300068 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:47.300516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:47.301278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:47.301712 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:47.433062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:47.441484 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e3e2febf-6972-4d07-baaf-71d33e972471 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1683 microversion: 2.1 time: 0.152793 May 12 17:46:47.442078 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 302/606] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:47 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:48.155053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-368272676", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2097308627", "security_groups": [{"name": "tempest-secgroup-smoke-49001733"}], "networks": [{"uuid": "068e07bd-56b1-45cc-b3d6-75b884746996"}], "block_device_mapping_v2": [{"uuid": "527bc15b-6c83-4bb3-9958-03e88b62e08d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:48.271081 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] validate_networks() for [('068e07bd-56b1-45cc-b3d6-75b884746996', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:46:48.458556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:48.459195 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:48.465544 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.465992 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.467525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.468130 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.598385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:48.606101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-72c02496-0dd6-4c84-b7d8-955f676337bb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1683 microversion: 2.1 time: 0.151361 May 12 17:46:48.606694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 303/607] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:48 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:48.641019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:46:48.641436 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:46:48.641955 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:46:48.642472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:46:48.642917 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:46:48.651695 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.652161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.652963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.653400 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.670393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Getting quotas for project 667ee24fd13d4432a040a745bf2a0d0e. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:46:48.674585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Getting quotas for user 2afcd57a10c14963acd187bd2aabb229 and project 667ee24fd13d4432a040a745bf2a0d0e. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:46:48.729557 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:46:48.731908 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='527bc15b-6c83-4bb3-9958-03e88b62e08d',volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:46:48.854370 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-48ee7937-5f25-4bbd-ad5a-c1f2c2585fd2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.703840 May 12 17:46:48.855063 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 305/608] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:46:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:46:48.865739 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7282c782-9bc2-47ec-859e-fb3836a5dc5e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:48.866344 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7282c782-9bc2-47ec-859e-fb3836a5dc5e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:48.899059 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:48.899573 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:48.906942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.907397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.908205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.908644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.923701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7282c782-9bc2-47ec-859e-fb3836a5dc5e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:48.930586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7282c782-9bc2-47ec-859e-fb3836a5dc5e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1088 microversion: 2.1 time: 0.068653 May 12 17:46:48.931385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 304/609] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:48 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:48.992339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lazy-loading 'services' on Instance uuid a8049559-bf00-4160-8e46-9a2d0a910c1a {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:49.064283 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9aa467bb-d977-46f6-8d23-1a5a85d0c579 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a/os-volume_attachments/6694872f-7edd-4f2f-bcb8-54d002e2b0ed" status: 202 len: 0 microversion: 2.1 time: 0.169541 May 12 17:46:49.064970 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 306/610] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:46:48 2022] DELETE /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a/os-volume_attachments/6694872f-7edd-4f2f-bcb8-54d002e2b0ed => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:46:49.624226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:49.624862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:49.631976 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.632448 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:49.633219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.633665 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:49.766334 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:49.777652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-db2b4038-5feb-4568-bde5-3dd6ff16aed9 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1683 microversion: 2.1 time: 0.157336 May 12 17:46:49.778936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 305/611] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:49 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:49.949206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:49.958750 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:49.971364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.971739 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:49.972781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.973220 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.059514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.067787 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7a55878a-6d66-4b84-a437-516c60060d4c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1130 microversion: 2.1 time: 0.123296 May 12 17:46:50.068663 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 307/612] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:49 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1130 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:50.088361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-14ebf57a-8ce8-43d2-b2e2-6c948f5ed0e5 req-2ac32f2b-5e05-4ca8-815d-d0d6937fcbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70784c5b-3ded-4e8a-ab43-6e738bf4eea5", "name": "network-vif-deleted", "tag": "b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:50.096259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-14ebf57a-8ce8-43d2-b2e2-6c948f5ed0e5 req-2ac32f2b-5e05-4ca8-815d-d0d6937fcbe8 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.097236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-14ebf57a-8ce8-43d2-b2e2-6c948f5ed0e5 req-2ac32f2b-5e05-4ca8-815d-d0d6937fcbe8 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.111477 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-14ebf57a-8ce8-43d2-b2e2-6c948f5ed0e5 req-2ac32f2b-5e05-4ca8-815d-d0d6937fcbe8 service nova] Creating event network-vif-deleted:b9d66198-e5f2-4d9a-bbb1-ddf2fc880cd1 for instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 on hv-cinder-83979 May 12 17:46:50.118293 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-14ebf57a-8ce8-43d2-b2e2-6c948f5ed0e5 req-2ac32f2b-5e05-4ca8-815d-d0d6937fcbe8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 May 12 17:46:50.119840 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 306/613] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:50.797585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:50.798345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:50.804527 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.804987 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.805791 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.806359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.839565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.840013 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.840463 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lazy-loading 'fault' on Instance uuid 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:50.900313 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.909053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-27735d97-b811-4b50-9588-7a788754fef5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 200 len: 1331 microversion: 2.1 time: 0.116142 May 12 17:46:50.910956 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 308/614] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:50 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:51.086073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.086822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.095038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.095580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.096742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.097913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.160821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:51.168092 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a0ca403d-283f-425e-9f70-c6897f37bdb6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1204 microversion: 2.1 time: 0.086497 May 12 17:46:51.168677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 307/615] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:51 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:51.253088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.253588 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.260080 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.260455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.261226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.261661 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.288240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:46:51.382064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5f6519aa-d16e-42a3-9117-6515c454cb7e tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 204 len: 0 microversion: 2.1 time: 0.132481 May 12 17:46:51.385684 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 309/616] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:46:51 2022] DELETE /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 17:46:51.392404 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.393536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.401292 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.401919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.402712 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.403141 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.538265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:51.547076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-03e21df8-87a6-4d22-a9bd-f48278e10386 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1513 microversion: 2.1 time: 0.159392 May 12 17:46:51.547651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 308/617] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:51 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:51.928885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.929874 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.936133 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.936585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.937584 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.938020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.952625 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 HTTP/1.1 May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:46:51.954946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:46:51.956268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '70784c5b-3ded-4e8a-ab43-6e738bf4eea5'} May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:51.957039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:46:51.958243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:51.960350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:51.961680 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-66c379a6-e933-4fe4-a958-3c28fa52a229 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 404 len: 111 microversion: 2.1 time: 0.036664 May 12 17:46:51.962580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 310/618] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:51 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:51.972125 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-76f9f0be-accd-4598-9962-ab95375bdfdd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '.version_select at 0x7f24bc2c3040>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.990282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-76f9f0be-accd-4598-9962-ab95375bdfdd tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873705230" status: 202 len: 0 microversion: 2.1 time: 0.022429 May 12 17:46:51.991003 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 309/619] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 12 17:46:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873705230 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:46:52.186379 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:52.187027 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:52.195623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.196083 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.196863 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.197303 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.427614 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.434901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c3005264-a173-46c0-a613-41e6d47455fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1270 microversion: 2.1 time: 0.253366 May 12 17:46:52.435627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 311/620] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:52 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:52.564538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:52.565155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:52.571123 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.571515 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.572294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.572737 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.707396 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.715080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-aba51c98-e330-4ad4-a479-c2caba2f7835 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1513 microversion: 2.1 time: 0.154927 May 12 17:46:52.715692 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8fa37b4d-9a95-417b-927a-c363f014532d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: .version_select at 0x7f24bc3029d0>, body: {"keypair": {"name": "tempest-keypair-2077573384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD6rINJOTGA1zHlidjaP7vQ7t0qMoCUiJq5YlYYZNgqzzVd7ppw1vbB7BUJ4Tdss0YccKpdkGsvj9KwZ8ofGdGD4O0lrvk3lTBRPUUfWTHUrfeh8DyKF6a0A7BGj8v39g=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:52.715839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 310/621] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:52 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:52.729770 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-8fa37b4d-9a95-417b-927a-c363f014532d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:46:52.734264 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-8fa37b4d-9a95-417b-927a-c363f014532d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:46:52.757187 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8fa37b4d-9a95-417b-927a-c363f014532d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045372 May 12 17:46:52.757773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 312/622] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:46:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:53.452633 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:53.453271 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:53.459096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.459548 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.460308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.460738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.697247 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:53.705268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-aaa5e727-c697-414e-87ac-4fc81643318b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1270 microversion: 2.1 time: 0.256752 May 12 17:46:53.705769 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 311/623] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:53 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1270 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:53.732882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:53.733529 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:53.739508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.739951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.740724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.741154 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.970482 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:53.977866 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c9e22d7b-ca0c-448c-b439-9a7a5d01e544 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1513 microversion: 2.1 time: 0.249581 May 12 17:46:53.987312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 313/624] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:53 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:54.167303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-532997750", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f0e5ba6-f1dc-4741-a091-633af3cfbec5"}], "security_groups": [{"name": "tempest-securitygroup--1176691599"}], "key_name": "tempest-keypair-2077573384", "user_data": "}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:54.272561 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] validate_networks() for [('5f0e5ba6-f1dc-4741-a091-633af3cfbec5', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:46:54.685141 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-f739621c-51f9-4eb5-9f0d-9dd07ad28506 req-e57daaae-a198-4a2a-875d-a645a53172e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94af4804-8a27-4f9b-b471-7fa1a1dabedf", "tag": "4903dc03-9110-43e6-bfaf-db2e0fe64355"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:54.696050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f739621c-51f9-4eb5-9f0d-9dd07ad28506 req-e57daaae-a198-4a2a-875d-a645a53172e0 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.696980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f739621c-51f9-4eb5-9f0d-9dd07ad28506 req-e57daaae-a198-4a2a-875d-a645a53172e0 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.723853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:46:54.724320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:46:54.724793 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:46:54.725014 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-f739621c-51f9-4eb5-9f0d-9dd07ad28506 req-e57daaae-a198-4a2a-875d-a645a53172e0 service nova] Creating event network-changed:4903dc03-9110-43e6-bfaf-db2e0fe64355 for instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf on hv-cinder-83979 May 12 17:46:54.725208 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:46:54.727035 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:46:54.731297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-f739621c-51f9-4eb5-9f0d-9dd07ad28506 req-e57daaae-a198-4a2a-875d-a645a53172e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050574 May 12 17:46:54.732223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 314/625] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:46:54.740625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.741137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.741316 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:54.742120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.742565 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.742916 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:54.757831 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.758533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.759515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.760393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.766825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:46:54.772235 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:46:54.788163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:46:54.792295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:46:54.856882 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2526f03b-d0d7-4738-b633-98740404093f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.693723 May 12 17:46:54.858569 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 312/626] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:46:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:46:54.870634 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1bdb3aba-0839-47d3-bc19-ef1f484c688c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:54.871624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1bdb3aba-0839-47d3-bc19-ef1f484c688c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:54.944005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1bdb3aba-0839-47d3-bc19-ef1f484c688c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:54.951028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1bdb3aba-0839-47d3-bc19-ef1f484c688c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1241 microversion: 2.1 time: 0.084819 May 12 17:46:54.951608 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 313/627] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:54 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:54.995321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:54.996032 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:55.003977 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.004544 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.005420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.006062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.094222 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:55.105907 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-46e02217-5b2d-4c08-9458-965a3c66eb69 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.371211 May 12 17:46:55.106885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 315/628] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:54 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:55.172122 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:55.180201 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-02c40571-c4df-442c-b851-35dadd879ab7 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1513 microversion: 2.1 time: 0.189281 May 12 17:46:55.187519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 314/629] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:54 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:55.969302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:55.970036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:55.976420 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.976948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.977796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.978299 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.041933 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:56.050255 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-82c685ae-1865-4a96-808e-fefc750f1ce0 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1293 microversion: 2.1 time: 0.085751 May 12 17:46:56.050833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 316/630] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:55 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:56.124330 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:56.125093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:56.131519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.131974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.132743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.133184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.197689 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:56.198417 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:56.204977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.205438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.206228 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.206691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.272154 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588930f5618c4d7d92de82a89a17d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efa2685b0ca4a4e86626fddbd68e4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:56.279968 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ddd12acc-43c1-4a7c-bd52-fabaec0806c3 tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 200 len: 1303 microversion: 2.1 time: 0.086389 May 12 17:46:56.280127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:56.280550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 317/631] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:56 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:56.287531 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0283e8a9-9c2f-429c-8e1b-bae6bb74d1a6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.167940 May 12 17:46:56.288095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 315/632] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:56 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:56.749259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-e3e94303-3036-4e05-b6e4-5d5c789555d2 req-03fad77d-3e36-4ee2-ac6c-72c8af7bd70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8049559-bf00-4160-8e46-9a2d0a910c1a", "name": "network-vif-deleted", "tag": "6a3e3572-f068-4297-9d91-839b7beaff17"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:56.757240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-e3e94303-3036-4e05-b6e4-5d5c789555d2 req-03fad77d-3e36-4ee2-ac6c-72c8af7bd70e service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.757690 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-e3e94303-3036-4e05-b6e4-5d5c789555d2 req-03fad77d-3e36-4ee2-ac6c-72c8af7bd70e service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.768399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-e3e94303-3036-4e05-b6e4-5d5c789555d2 req-03fad77d-3e36-4ee2-ac6c-72c8af7bd70e service nova] Creating event network-vif-deleted:6a3e3572-f068-4297-9d91-839b7beaff17 for instance a8049559-bf00-4160-8e46-9a2d0a910c1a on hv-cinder-83979 May 12 17:46:56.773376 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-e3e94303-3036-4e05-b6e4-5d5c789555d2 req-03fad77d-3e36-4ee2-ac6c-72c8af7bd70e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028490 May 12 17:46:56.773944 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 318/633] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:57.067742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:57.068449 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:57.074626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:57.075722 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:57.076821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:57.077334 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:57.144178 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:57.155378 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4c52aec1-083d-4392-9e48-f9531ba23e85 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1299 microversion: 2.1 time: 0.091442 May 12 17:46:57.155856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 316/634] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:57 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:57.297628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:57.298455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] [instance: a8049559-bf00-4160-8e46-9a2d0a910c1a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:57.305417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:57.305627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:57.306005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:57.306404 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:57.307152 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:57.307817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:57.313742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:57.314208 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:57.315019 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:57.315656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:57.323305 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] HTTP exception thrown: Instance a8049559-bf00-4160-8e46-9a2d0a910c1a could not be found. May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Request method failure captured: May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a HTTP/1.1 May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUdwofnp8wEZYISytiWEeqVXvHt5P-fGVsV6d3_aayNony_Yfc9nyuCpXL-sbIIJ_0sglWa4lM-3MLIJ5SLAKDMWEGwovypI8x-EkU09t3rh7BM6MnQJ4QxqkX5RMYCbFAstbCADza5fNjAG6TBc5PZyyAM-1_OBktNftmu7bEMRZ6E May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 5efa2685b0ca4a4e86626fddbd68e4ed May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2096800864 May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:46:57.325053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5efa2685b0ca4a4e86626fddbd68e4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5efa2685b0ca4a4e86626fddbd68e4ed", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5efa2685b0ca4a4e86626fddbd68e4ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5efa2685b0ca4a4e86626fddbd68e4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-VolumesSnapshotTestJSON-2096800864 May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 5efa2685b0ca4a4e86626fddbd68e4ed May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2096800864 May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-VolumesSnapshotTestJSON-2096800864-project May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 588930f5618c4d7d92de82a89a17d923 May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-VolumesSnapshotTestJSON-2096800864-project May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance a8049559-bf00-4160-8e46-9a2d0a910c1a could not be found. May 12 17:46:57.326386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'a8049559-bf00-4160-8e46-9a2d0a910c1a'} May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8049559-bf00-4160-8e46-9a2d0a910c1a could not be found. May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:57.327460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8049559-bf00-4160-8e46-9a2d0a910c1a could not be found. May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8049559-bf00-4160-8e46-9a2d0a910c1a could not be found. May 12 17:46:57.328854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:46:57.330100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] Returning 404 to user: Instance a8049559-bf00-4160-8e46-9a2d0a910c1a could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:57.330100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-732a8e77-aa89-400b-90b4-9256410cca2f tempest-VolumesSnapshotTestJSON-2096800864 tempest-VolumesSnapshotTestJSON-2096800864-project] 10.222.0.76 "GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a" status: 404 len: 111 microversion: 2.1 time: 0.033799 May 12 17:46:57.330100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 319/635] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:57 2022] GET /compute/v2.1/servers/a8049559-bf00-4160-8e46-9a2d0a910c1a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:57.473065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:57.483257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ff0c3eb2-3056-49b5-84e9-7561fd843210 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.182365 May 12 17:46:57.483953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 317/636] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:57 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:58.172229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:58.173071 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:58.179440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.179887 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.180694 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.181128 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.413710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:58.422505 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8853be5e-df8f-4f7c-b50b-dfa86c76f148 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.254695 May 12 17:46:58.423408 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 320/637] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:58 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:58.500178 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:58.500783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:58.507090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.507546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.508311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.508743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.673589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:58.681373 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-89b7d636-24b2-4580-8780-8d6baa6b1668 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.185196 May 12 17:46:58.682238 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 318/638] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:58 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:58.788671 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-2c6c670c-72db-4344-9b6a-e55229faaea2 req-5893aa0b-b3d2-41a7-aa65-37b1a18fde58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd7e68e-d36e-4be7-83e3-e12e7df966b5", "tag": "bd6a624b-c038-4a0f-9ac2-0c9196600d48"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:58.799037 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2c6c670c-72db-4344-9b6a-e55229faaea2 req-5893aa0b-b3d2-41a7-aa65-37b1a18fde58 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.799576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2c6c670c-72db-4344-9b6a-e55229faaea2 req-5893aa0b-b3d2-41a7-aa65-37b1a18fde58 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.812215 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-2c6c670c-72db-4344-9b6a-e55229faaea2 req-5893aa0b-b3d2-41a7-aa65-37b1a18fde58 service nova] Creating event network-changed:bd6a624b-c038-4a0f-9ac2-0c9196600d48 for instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 on hv-cinder-83979 May 12 17:46:58.817155 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-2c6c670c-72db-4344-9b6a-e55229faaea2 req-5893aa0b-b3d2-41a7-aa65-37b1a18fde58 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032190 May 12 17:46:58.817967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 321/639] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:59.439802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:59.440437 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:59.446550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:59.447031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:59.447839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:59.448338 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:59.572658 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:59.580374 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-414c4134-7448-449d-b888-8d792bb914fb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.144437 May 12 17:46:59.580926 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 319/640] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:59 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:59.699402 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:59.700104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:59.706239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:59.706725 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:59.707501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:59.707942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:59.837687 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:59.845075 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c7fecc50-8993-4298-8a1e-12a82e8405ac tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.150337 May 12 17:46:59.845641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 322/641] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:46:59 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:00.597567 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:00.598242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:00.604253 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.604708 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:00.605480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.605962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:00.735908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:00.743264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b583cb39-ca83-4939-a587-730399858b2c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.150962 May 12 17:47:00.743899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 320/642] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:00 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:00.862156 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:00.862693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:00.869072 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.869527 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:00.870291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.870753 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:01.004534 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:01.011765 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e1e5bdfa-2595-4774-b2c5-e287df4b3591 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.153831 May 12 17:47:01.012329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 323/643] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:00 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:01.760726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:01.761332 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:01.768574 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:01.769022 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:01.769790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:01.770475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:01.897956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:01.905739 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7bfe08ea-b00a-4614-a4cc-280239cc34ed tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.148295 May 12 17:47:01.906341 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 321/644] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:01 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:02.030506 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:02.031056 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:02.037470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.037922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:02.038721 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.039163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:02.169664 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:02.177118 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4e83b568-9762-44d5-9e8e-63eab38004bc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.151540 May 12 17:47:02.177687 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 324/645] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:02 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:02.923968 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:02.924586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:02.930838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.931284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:02.932038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.932467 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:03.067244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:03.074835 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ae3017f1-a700-40c1-8d3d-9337dd5c19ee tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.155961 May 12 17:47:03.075411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 322/646] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:02 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:03.194357 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:03.195040 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:03.202590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:03.203188 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:03.204030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:03.204496 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:03.351335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:03.359825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-63f2575b-a9fc-409b-9d1c-c5729e9aa2d4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.170307 May 12 17:47:03.360581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 325/647] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:03 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:04.092896 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:04.093500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:04.100068 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.100529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:04.101339 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.101783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:04.230357 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:04.238694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d5f9c9b3-dfae-4aa0-a4e8-3633c1ea6968 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.149507 May 12 17:47:04.239217 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 323/648] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:04 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:04.377339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:04.378207 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:04.384880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.385523 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:04.386307 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.386767 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:04.536931 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:04.544236 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-21e0b1e8-4168-4f45-8036-eaf1ac053ec1 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.171537 May 12 17:47:04.544802 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 326/649] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:04 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:05.255662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:05.256300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:05.262573 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:05.263056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:05.263813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:05.265028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:05.393828 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:05.401349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c7326eef-29f4-4855-bc6c-c3f8000ecd29 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.149549 May 12 17:47:05.401916 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 324/650] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:05 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:05.561819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:05.562885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:05.569094 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:05.569545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:05.570318 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:05.570780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:05.702628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:05.710123 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c42aa0b9-ac50-4f55-9de1-cd5dd3671320 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.152797 May 12 17:47:05.710697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 327/651] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:05 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:06.418408 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:06.419280 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:06.426942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:06.426942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.427681 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:06.428118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.565110 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:06.572671 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-461f6b43-a7c7-4719-bb31-4a7438cf6925 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.158347 May 12 17:47:06.573241 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 325/652] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:06 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:06.618848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-549c781e-7038-40b0-9f03-48dec65102c3 req-628e5c69-98b3-4686-81a3-17291462c735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7e68e-d36e-4be7-83e3-e12e7df966b5", "name": "network-vif-plugged", "status": "completed", "tag": "bd6a624b-c038-4a0f-9ac2-0c9196600d48"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:06.629075 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-549c781e-7038-40b0-9f03-48dec65102c3 req-628e5c69-98b3-4686-81a3-17291462c735 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:06.629525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-549c781e-7038-40b0-9f03-48dec65102c3 req-628e5c69-98b3-4686-81a3-17291462c735 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.641885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-549c781e-7038-40b0-9f03-48dec65102c3 req-628e5c69-98b3-4686-81a3-17291462c735 service nova] Creating event network-vif-plugged:bd6a624b-c038-4a0f-9ac2-0c9196600d48 for instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 on hv-cinder-83979 May 12 17:47:06.647197 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-549c781e-7038-40b0-9f03-48dec65102c3 req-628e5c69-98b3-4686-81a3-17291462c735 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032496 May 12 17:47:06.648102 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 328/653] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:06.727180 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:06.728084 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:06.740558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:06.741041 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.741964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:06.742408 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.884783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:06.892854 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-10b316af-229e-4188-b7f7-34a40612e9b9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.169548 May 12 17:47:06.893434 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 326/654] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:06 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:07.589893 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:07.590588 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:07.597470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.597926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:07.598726 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.599166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:07.737369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:07.744630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-27fb6e6b-ec4b-4597-8887-9a0108b2c61b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.158951 May 12 17:47:07.745136 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 329/655] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:07 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:07.910429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:07.911059 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:07.917397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.917847 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:07.918611 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.919074 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:08.051967 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:08.059357 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8a8315b6-2178-41f8-a6f7-e9d242a1b304 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.152960 May 12 17:47:08.059920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 327/656] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:07 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:08.762137 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:08.762763 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:08.769633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:08.770084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:08.771141 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:08.771574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:08.902242 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:08.909655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-662a522c-24d0-4046-824c-d37c13ae1a4a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.151368 May 12 17:47:08.910229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 330/657] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:08 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:09.076310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:09.076915 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:09.084410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.084858 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.085616 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.086049 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.209259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:09.209758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:09.215641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.216100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.216877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.217293 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:09.217413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.225135 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ad12d0ab-a025-4d4f-9e8e-1c026d443a4b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.152562 May 12 17:47:09.225705 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 328/658] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:09 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:09.297970 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lazy-loading 'services' on Instance uuid a92a89c3-a796-4a8b-9491-3f944bca5a9b {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:47:09.367187 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-24ab1f5f-b761-400c-8d41-213ef8f5abd5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-volume_attachments/5945be37-a201-47f9-99ef-0965e61df60e" status: 202 len: 0 microversion: 2.1 time: 0.161663 May 12 17:47:09.367774 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 331/659] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:47:09 2022] DELETE /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-volume_attachments/5945be37-a201-47f9-99ef-0965e61df60e => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:47:09.926695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:09.927325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:09.933302 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.933757 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.934526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.934999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:10.069071 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:10.076531 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e65038a8-f292-46db-8454-584ff899d895 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.153754 May 12 17:47:10.077088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 329/660] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:09 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:10.243800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:10.244547 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:10.251759 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:10.252203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:10.252963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:10.253393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:10.386292 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:10.394803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8be6c435-dc21-4bfd-b0c7-8d858ec6f4db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.155678 May 12 17:47:10.395617 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 332/661] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:10 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:10.897795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-3c963dcf-dc45-4657-877e-65b600329854 req-d847f261-b2ef-49b8-89a9-c3151eee6c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94af4804-8a27-4f9b-b471-7fa1a1dabedf", "name": "network-vif-plugged", "status": "completed", "tag": "4903dc03-9110-43e6-bfaf-db2e0fe64355"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:10.907464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-3c963dcf-dc45-4657-877e-65b600329854 req-d847f261-b2ef-49b8-89a9-c3151eee6c19 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:10.907926 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-3c963dcf-dc45-4657-877e-65b600329854 req-d847f261-b2ef-49b8-89a9-c3151eee6c19 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:10.919912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-3c963dcf-dc45-4657-877e-65b600329854 req-d847f261-b2ef-49b8-89a9-c3151eee6c19 service nova] Creating event network-vif-plugged:4903dc03-9110-43e6-bfaf-db2e0fe64355 for instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf on hv-cinder-83979 May 12 17:47:10.925957 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-3c963dcf-dc45-4657-877e-65b600329854 req-d847f261-b2ef-49b8-89a9-c3151eee6c19 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 May 12 17:47:10.926561 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 330/662] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:11.093226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:11.094396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:11.100340 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:11.100797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:11.101644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:11.102081 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:11.253814 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:11.267623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-eb9b58f0-a9c0-4949-9630-28fe3b3e1f06 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1367 microversion: 2.1 time: 0.178128 May 12 17:47:11.268198 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 333/663] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:11 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:11.417962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:11.418662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:11.424966 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:11.425413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:11.426182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:11.426615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:11.572464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:11.580591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cdcfd61c-4f6f-4b08-9f6a-60294928aee9 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.166850 May 12 17:47:11.581165 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 331/664] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:11 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:12.285682 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:12.286294 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:12.292649 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.293101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.294107 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.294543 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.420579 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:12.428977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5aa025f3-94f1-4949-a342-c3ff0b8cad74 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1557 microversion: 2.1 time: 0.147813 May 12 17:47:12.429559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 334/665] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:12 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:12.446323 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-81e27613-75a3-4882-b5ae-41e0e79b7d5d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:12.446862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-81e27613-75a3-4882-b5ae-41e0e79b7d5d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:12.453646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81e27613-75a3-4882-b5ae-41e0e79b7d5d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.454191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81e27613-75a3-4882-b5ae-41e0e79b7d5d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.455002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81e27613-75a3-4882-b5ae-41e0e79b7d5d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.455442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-81e27613-75a3-4882-b5ae-41e0e79b7d5d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.541128 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-81e27613-75a3-4882-b5ae-41e0e79b7d5d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099311 May 12 17:47:12.541698 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 332/666] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:47:12 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:12.598493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-00140c0b-1c69-406b-a384-6c1d1e2fbd2b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:12.599226 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:12.601492 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:12.605582 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-00140c0b-1c69-406b-a384-6c1d1e2fbd2b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.606255 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-00140c0b-1c69-406b-a384-6c1d1e2fbd2b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.608155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.608685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.609486 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.610239 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.638720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-00140c0b-1c69-406b-a384-6c1d1e2fbd2b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Going to try to stop instance {{(pid=123688) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 17:47:12.694898 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-00140c0b-1c69-406b-a384-6c1d1e2fbd2b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.102471 May 12 17:47:12.696279 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 335/667] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:47:12 2022] POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:47:12.705320 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:12.706026 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:12.712038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.712492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.713268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.713712 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.846931 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:12.848879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:12.854407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5e41356d-55a5-4ec7-b5a6-130973b280db tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1258 microversion: 2.1 time: 0.260987 May 12 17:47:12.855371 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 333/668] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:12 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1258 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:12.857710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4387b23c-c83a-4266-b747-c2423754547c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.157164 May 12 17:47:12.858352 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 336/669] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:12 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:13.850812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-e6e77d58-fdb1-43b8-a6d4-b1fcd5e1d816 req-a5d0d282-4f99-4d0d-9f33-d1f2a4fc3041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd7e68e-d36e-4be7-83e3-e12e7df966b5", "tag": "bd6a624b-c038-4a0f-9ac2-0c9196600d48"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:13.861183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-e6e77d58-fdb1-43b8-a6d4-b1fcd5e1d816 req-a5d0d282-4f99-4d0d-9f33-d1f2a4fc3041 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.861726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-e6e77d58-fdb1-43b8-a6d4-b1fcd5e1d816 req-a5d0d282-4f99-4d0d-9f33-d1f2a4fc3041 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.871043 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:13.872253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:13.873529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-e6e77d58-fdb1-43b8-a6d4-b1fcd5e1d816 req-a5d0d282-4f99-4d0d-9f33-d1f2a4fc3041 service nova] Creating event network-changed:bd6a624b-c038-4a0f-9ac2-0c9196600d48 for instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 on hv-cinder-83979 May 12 17:47:13.879137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-e6e77d58-fdb1-43b8-a6d4-b1fcd5e1d816 req-a5d0d282-4f99-4d0d-9f33-d1f2a4fc3041 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032294 May 12 17:47:13.880016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 334/670] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:13.883563 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.884233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.885218 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.885391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:13.885857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.886232 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:13.893056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.893608 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.894456 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.894985 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.037746 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.041742 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.045605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9145e73d-4268-4c58-8821-2de9dbf90cbd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.164550 May 12 17:47:14.046196 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 335/671] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:13 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:14.055903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2fc4c36f-478d-4f76-84d5-f8cdd5da111a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1443 microversion: 2.1 time: 0.186471 May 12 17:47:14.055903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 337/672] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:13 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1443 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:14.070850 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:14.071456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:14.079144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.079610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.080392 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.080827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.263355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.271519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f713fb3d-6934-48c3-be5e-b028b80f3610 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1443 microversion: 2.1 time: 0.204432 May 12 17:47:14.272522 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 338/673] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:14 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1443 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:15.064065 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:15.064682 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:15.072394 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.073138 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:15.079539 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.080269 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:15.228722 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:15.236219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8cddb9be-67a7-47e7-a63e-0aac201775d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.176801 May 12 17:47:15.237026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 336/674] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:15 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:16.254414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:16.255166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:16.261525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:16.261973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.262805 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:16.263253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.463013 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:16.470291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6ec6c659-8da1-47e4-bb4e-b994e2535afc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.220657 May 12 17:47:16.470888 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 339/675] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:16 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:16.626636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-92981a98-6b33-4a9b-8e9e-f8bf334ca3ad req-55677d60-94e9-4be5-8a53-18ea73dd4e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94af4804-8a27-4f9b-b471-7fa1a1dabedf", "tag": "4903dc03-9110-43e6-bfaf-db2e0fe64355"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:16.634972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-92981a98-6b33-4a9b-8e9e-f8bf334ca3ad req-55677d60-94e9-4be5-8a53-18ea73dd4e91 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:16.635416 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-92981a98-6b33-4a9b-8e9e-f8bf334ca3ad req-55677d60-94e9-4be5-8a53-18ea73dd4e91 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.646835 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-92981a98-6b33-4a9b-8e9e-f8bf334ca3ad req-55677d60-94e9-4be5-8a53-18ea73dd4e91 service nova] Creating event network-changed:4903dc03-9110-43e6-bfaf-db2e0fe64355 for instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf on hv-cinder-83979 May 12 17:47:16.651708 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-92981a98-6b33-4a9b-8e9e-f8bf334ca3ad req-55677d60-94e9-4be5-8a53-18ea73dd4e91 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029403 May 12 17:47:16.652505 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 337/676] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:17.486596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:17.487244 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:17.493860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:17.494316 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:17.495246 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:17.495913 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:17.643007 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:17.650571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-279f7c8f-3668-40f2-b7d7-bffab91b41ad tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.167900 May 12 17:47:17.651171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 340/677] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:17 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:18.669853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:18.670534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:18.677622 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:18.678066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.678868 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:18.679303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.811801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:18.819192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-31590ead-9411-4e1c-bf9e-6c6232a839d5 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.154373 May 12 17:47:18.819765 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 338/678] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:18 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:19.836424 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:19.837036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:19.844443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.844959 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:19.845816 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.846260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:19.978232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:19.986098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-56720675-5c59-41cf-90b5-4dbb11299499 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.153723 May 12 17:47:19.986655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 341/679] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:19 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:21.003918 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:21.004531 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:21.010359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:21.010851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:21.011630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:21.012069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:21.151371 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:21.159310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-425be12f-e77c-4ce1-9bc1-d55ea394ef7a tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.159902 May 12 17:47:21.159890 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 339/680] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:20 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:22.177698 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:22.178285 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:22.184529 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.184972 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.185728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.186158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.318343 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:22.325894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7e211913-44e6-4655-ada7-6d811707ca96 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.152058 May 12 17:47:22.326465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 342/681] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:22 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:23.342266 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:23.342925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:23.349349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.349803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.350567 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.351372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.481155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:23.489348 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3f775e2e-2607-408a-aced-83360f1ef73d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1678 microversion: 2.1 time: 0.150920 May 12 17:47:23.489851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 340/682] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:23 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:24.509288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:24.509876 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:24.517274 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.517721 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.518495 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.518961 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.654399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:24.662268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ac614fd7-55ad-4f7c-bbbc-8161d6b1b608 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1655 microversion: 2.1 time: 0.156932 May 12 17:47:24.662856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 343/683] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:24 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:24.679432 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c6441417-503d-4b41-85fd-837ad1af023e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:24.685775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c6441417-503d-4b41-85fd-837ad1af023e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.686224 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c6441417-503d-4b41-85fd-837ad1af023e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.744716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c6441417-503d-4b41-85fd-837ad1af023e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Going to try to start instance {{(pid=123689) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 17:47:24.786015 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c6441417-503d-4b41-85fd-837ad1af023e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.110232 May 12 17:47:24.786534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 341/684] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:47:24 2022] POST /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:47:24.794765 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:24.795507 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:24.802101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.802578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.803574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.804193 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.971399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:24.978813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5ae550f6-1d34-406d-8fc0-ef2f1c74aee7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1664 microversion: 2.1 time: 0.187969 May 12 17:47:24.979377 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 344/685] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:24 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1664 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:25.997818 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:25.998515 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:26.004735 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.005186 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:26.005951 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.006389 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:26.133649 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:26.141524 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-218ac2ee-2715-458f-8edf-a882387dbc5d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1664 microversion: 2.1 time: 0.147803 May 12 17:47:26.142719 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 342/686] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:25 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:27.159827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:27.160429 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:27.166711 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:27.167170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:27.167945 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:27.168383 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:27.296249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:27.304519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0803b979-65b3-4a77-b55e-c5584c679c0e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1668 microversion: 2.1 time: 0.149101 May 12 17:47:27.305085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 345/687] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:27 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:32.352837 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-bd3f9228-7c88-4da8-842e-d094d7496403 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30d598e0-d2a9-46a8-98f8-b6e22a8a7b8b"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:32.353923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-bd3f9228-7c88-4da8-842e-d094d7496403 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:32.360414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bd3f9228-7c88-4da8-842e-d094d7496403 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.360872 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bd3f9228-7c88-4da8-842e-d094d7496403 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:32.361647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bd3f9228-7c88-4da8-842e-d094d7496403 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.362090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bd3f9228-7c88-4da8-842e-d094d7496403 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:32.596228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-bd3f9228-7c88-4da8-842e-d094d7496403 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247216 May 12 17:47:32.596840 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 343/688] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:47:32 2022] POST /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:32.975152 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3668970f-5236-47bd-b046-86713d5e7132 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:32.975714 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3668970f-5236-47bd-b046-86713d5e7132 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:32.982104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3668970f-5236-47bd-b046-86713d5e7132 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.982559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3668970f-5236-47bd-b046-86713d5e7132 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:32.983425 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3668970f-5236-47bd-b046-86713d5e7132 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.983817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3668970f-5236-47bd-b046-86713d5e7132 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.012089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3668970f-5236-47bd-b046-86713d5e7132 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments/ce014f5b-969b-4219-a730-a2a095c8df80" status: 200 len: 194 microversion: 2.20 time: 0.041017 May 12 17:47:33.012662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 346/689] 10.222.0.76 () {60 vars in 1453 bytes} [Thu May 12 17:47:32 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments/ce014f5b-969b-4219-a730-a2a095c8df80 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:47:33.078070 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:33.078970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:33.084898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.085485 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.086300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.086840 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.171112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lazy-loading 'services' on Instance uuid 12b3f033-5f36-4355-8221-ab55bcba8722 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:47:33.243186 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-64f768c4-f1a3-4fcc-91e5-86cfd301eb77 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments/ce014f5b-969b-4219-a730-a2a095c8df80" status: 202 len: 0 microversion: 2.20 time: 0.170117 May 12 17:47:33.243978 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 344/690] 10.222.0.76 () {60 vars in 1456 bytes} [Thu May 12 17:47:33 2022] DELETE /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments/ce014f5b-969b-4219-a730-a2a095c8df80 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:47:33.253068 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-765863b2-09f5-4005-b7d6-0610f62d3957 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:33.254045 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-765863b2-09f5-4005-b7d6-0610f62d3957 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:33.260105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-765863b2-09f5-4005-b7d6-0610f62d3957 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.260555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-765863b2-09f5-4005-b7d6-0610f62d3957 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.261437 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-765863b2-09f5-4005-b7d6-0610f62d3957 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.261883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-765863b2-09f5-4005-b7d6-0610f62d3957 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.293130 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-765863b2-09f5-4005-b7d6-0610f62d3957 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044695 May 12 17:47:33.293695 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 347/691] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:33 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:34.304841 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-748c51a0-8ef2-4ad9-9e7b-14b06a8e457c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:34.305936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-748c51a0-8ef2-4ad9-9e7b-14b06a8e457c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:34.312442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748c51a0-8ef2-4ad9-9e7b-14b06a8e457c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:34.313556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748c51a0-8ef2-4ad9-9e7b-14b06a8e457c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:34.314336 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748c51a0-8ef2-4ad9-9e7b-14b06a8e457c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:34.314805 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748c51a0-8ef2-4ad9-9e7b-14b06a8e457c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:34.343468 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-748c51a0-8ef2-4ad9-9e7b-14b06a8e457c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042960 May 12 17:47:34.344534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 345/692] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:34 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:35.355982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a5c48de4-61c9-458a-9142-5287e510c49f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:35.356897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a5c48de4-61c9-458a-9142-5287e510c49f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:35.363706 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a5c48de4-61c9-458a-9142-5287e510c49f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.364161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a5c48de4-61c9-458a-9142-5287e510c49f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.364935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a5c48de4-61c9-458a-9142-5287e510c49f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.365375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a5c48de4-61c9-458a-9142-5287e510c49f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.397254 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a5c48de4-61c9-458a-9142-5287e510c49f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 May 12 17:47:35.397810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 348/693] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:35 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:36.411832 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9b194f59-0d53-4a47-8b92-24273866b194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:36.412851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9b194f59-0d53-4a47-8b92-24273866b194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:36.419337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b194f59-0d53-4a47-8b92-24273866b194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.419788 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b194f59-0d53-4a47-8b92-24273866b194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:36.420589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b194f59-0d53-4a47-8b92-24273866b194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.421023 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9b194f59-0d53-4a47-8b92-24273866b194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:36.450290 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9b194f59-0d53-4a47-8b92-24273866b194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042579 May 12 17:47:36.450878 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 346/694] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:36 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:37.461968 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e3126efa-4e20-438c-a49b-a12475a63161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:37.463084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e3126efa-4e20-438c-a49b-a12475a63161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:37.470360 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e3126efa-4e20-438c-a49b-a12475a63161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:37.470851 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e3126efa-4e20-438c-a49b-a12475a63161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:37.471621 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e3126efa-4e20-438c-a49b-a12475a63161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:37.472060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e3126efa-4e20-438c-a49b-a12475a63161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:37.501323 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e3126efa-4e20-438c-a49b-a12475a63161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043135 May 12 17:47:37.501806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 349/695] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:37 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:38.512805 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8b71e7bd-b638-431a-9a0a-8b826ef5939e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:38.513723 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8b71e7bd-b638-431a-9a0a-8b826ef5939e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:38.520310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b71e7bd-b638-431a-9a0a-8b826ef5939e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.521025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b71e7bd-b638-431a-9a0a-8b826ef5939e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.521789 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b71e7bd-b638-431a-9a0a-8b826ef5939e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.522224 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b71e7bd-b638-431a-9a0a-8b826ef5939e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.550861 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8b71e7bd-b638-431a-9a0a-8b826ef5939e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042070 May 12 17:47:38.551406 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 347/696] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:38 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:39.562458 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-42b8fd14-3d12-4175-b409-79cbc52fdccc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:39.563411 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-42b8fd14-3d12-4175-b409-79cbc52fdccc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:39.569996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42b8fd14-3d12-4175-b409-79cbc52fdccc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:39.570451 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42b8fd14-3d12-4175-b409-79cbc52fdccc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:39.571243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42b8fd14-3d12-4175-b409-79cbc52fdccc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:39.571683 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42b8fd14-3d12-4175-b409-79cbc52fdccc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:39.600092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-42b8fd14-3d12-4175-b409-79cbc52fdccc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041623 May 12 17:47:39.600631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 350/697] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:39 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:40.087441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:40.088387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:40.094535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.095116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.096428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.096855 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.120590 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lazy-loading 'flavor' on Instance uuid 0424abb5-9a1e-40d7-9293-6afed05d22a4 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:47:40.464755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-986a26c3-e715-45d2-a6bd-db87f142c307 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/action" status: 200 len: 32 microversion: 2.1 time: 0.381748 May 12 17:47:40.465354 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 348/698] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:47:40 2022] POST /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:47:40.475312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:40.476142 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:40.481871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.482314 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.483084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.483512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.613154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-514d8680-c10a-4b3c-aa0a-2788e2a36df9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:40.614171 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-514d8680-c10a-4b3c-aa0a-2788e2a36df9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:40.622224 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-514d8680-c10a-4b3c-aa0a-2788e2a36df9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.622858 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-514d8680-c10a-4b3c-aa0a-2788e2a36df9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.623694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-514d8680-c10a-4b3c-aa0a-2788e2a36df9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.624138 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-514d8680-c10a-4b3c-aa0a-2788e2a36df9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.655673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-514d8680-c10a-4b3c-aa0a-2788e2a36df9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047443 May 12 17:47:40.656167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 349/699] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:47:40 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:40.715585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:40.716076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:40.722762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.723215 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.723988 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.724426 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.750604 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:47:40.832168 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1cf6cba7-9447-471f-b370-ce589cbf7a93 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 204 len: 0 microversion: 2.20 time: 0.120113 May 12 17:47:40.832987 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.834784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 350/700] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 12 17:47:40 2022] DELETE /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 12 17:47:40.843272 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:40.843470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7ed977c3-2743-4fd0-a4cb-f5f769b7f505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.372169 May 12 17:47:40.844314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:40.844712 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 351/701] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:40 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:40.851678 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.852136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.853171 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.853595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.985421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.993973 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.995500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.996646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7575cdef-5adf-4db3-a52b-3be706dd7e68 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.158218 May 12 17:47:40.997198 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 351/702] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:40 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:41.862201 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:41.862830 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:41.869338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:41.869783 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:41.870551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:41.871009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:42.000936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.009309 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-906706c5-85a5-4de5-afc3-dab68f7aaade tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.151464 May 12 17:47:42.009871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 352/703] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:41 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:42.016546 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:42.017725 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:42.024240 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:42.024692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:42.025460 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:42.025899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:42.152802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.161174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.162689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.163825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2097172b-d1cd-49b5-92c4-4150393956d3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.151179 May 12 17:47:42.164371 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 352/704] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:42 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:43.026761 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:43.027439 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:43.034748 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.035206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.035988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.036423 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.183710 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:43.184606 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:43.192395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.192395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.193038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.193608 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.359112 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:43.373169 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c2f0ad34-f3eb-4c52-9492-40072c4a9362 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.350320 May 12 17:47:43.374060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 353/705] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:43 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:43.478734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:43.487392 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:43.488929 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:43.490109 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7de82aa7-6f71-48a6-8967-87a98541286c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1725 microversion: 2.20 time: 0.310568 May 12 17:47:43.490947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 353/706] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:43 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:44.002071 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-2d225b31-c739-4fd5-958c-049f59ff0742 req-452dfe83-f37b-46b7-b0bc-c2e80d020790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b3f033-5f36-4355-8221-ab55bcba8722", "name": "network-vif-deleted", "tag": "20f0b51d-9edf-437d-a233-3e26daa2ef7c"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:44.009964 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2d225b31-c739-4fd5-958c-049f59ff0742 req-452dfe83-f37b-46b7-b0bc-c2e80d020790 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:44.010622 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2d225b31-c739-4fd5-958c-049f59ff0742 req-452dfe83-f37b-46b7-b0bc-c2e80d020790 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:44.022937 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-2d225b31-c739-4fd5-958c-049f59ff0742 req-452dfe83-f37b-46b7-b0bc-c2e80d020790 service nova] Creating event network-vif-deleted:20f0b51d-9edf-437d-a233-3e26daa2ef7c for instance 12b3f033-5f36-4355-8221-ab55bcba8722 on hv-cinder-83979 May 12 17:47:44.028098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-2d225b31-c739-4fd5-958c-049f59ff0742 req-452dfe83-f37b-46b7-b0bc-c2e80d020790 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029919 May 12 17:47:44.029198 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 354/707] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:44.390953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:44.391646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:44.398990 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:44.399445 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:44.400401 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:44.400840 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:44.510187 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:44.511062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:44.518022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:44.518480 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:44.519291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:44.519912 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:44.537131 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:44.545087 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e1387a2c-a272-46b2-8a31-5fee8d438a43 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.158169 May 12 17:47:44.545906 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 354/708] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:44 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:44.555315 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:44.555773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:44.556224 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lazy-loading 'fault' on Instance uuid 12b3f033-5f36-4355-8221-ab55bcba8722 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:47:44.598499 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:44.606712 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:44.608305 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:44.609551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3c7387b8-a064-47b1-947e-a16c4c62d5ef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 200 len: 1372 microversion: 2.20 time: 0.104514 May 12 17:47:44.610450 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 355/709] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:44 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:45.562971 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:45.563583 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:45.570696 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.571158 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.571933 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.572373 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.629115 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:45.629739 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:45.636198 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.636659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.637442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.637880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.652307 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] HTTP exception thrown: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Request method failure captured: May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 HTTP/1.1 May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcZEndFWEd9sShVIO4-TR8jAlRApCUpwETZjIsbY8NGpukpHYXXYkzFUAcy_SchTmRAHDN_Kt_cAYyFUp238tp7w6uJP-vZMonIq0jjAY0ob-XxZEEyBdKqnFGmtX74RjDbnLstyij5JmQJTrcl3WDm-4jf30s-4S6RoT-eam5e_tU May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:47:45.653973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07bc791aa8d45d4a9e72758f39f6a85", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 10626535b6874ef58b63d259f059cd15 May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:47:45.655756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '12b3f033-5f36-4355-8221-ab55bcba8722'} May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:47:45.656666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:47:45.658779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:47:45.660100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Returning 404 to user: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:47:45.660100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e4efe4e8-403a-494a-9326-07c97df5b539 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 404 len: 111 microversion: 2.20 time: 0.030948 May 12 17:47:45.660100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 356/710] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:45 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 17:47:45.664817 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-622589d6-c2e3-4158-baa4-5a89c0d19be7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '.version_select at 0x7f24bc29e670>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:45.684126 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-622589d6-c2e3-4158-baa4-5a89c0d19be7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075359543" status: 204 len: 0 microversion: 2.20 time: 0.022906 May 12 17:47:45.684696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 357/711] 10.222.0.76 () {60 vars in 1261 bytes} [Thu May 12 17:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075359543 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:47:45.706883 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:45.714699 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-74c37dfb-7a9e-4c0f-9091-5b2ef75f3262 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.155654 May 12 17:47:45.715280 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 355/712] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:45 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:46.305942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-26e8a493-8260-47f1-925f-58f8427d609c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'create', calling method: .version_select at 0x7f24bc1e1a60>, body: {"keypair": {"name": "tempest-keypair-509714541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA355Y834PvKeuDLozO8w872ygxfCCT/isSve8eCUKJOKrMy+Tswu+odpMZ6fqgmU7LDn+Tn6zxrN2dzVtDkDE6fjjudvXqrrKoRcYF8GIYYePoSFCyQd6Y5LmrR0amSXw=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:46.322339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-26e8a493-8260-47f1-925f-58f8427d609c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:47:46.326192 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-26e8a493-8260-47f1-925f-58f8427d609c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for user 10626535b6874ef58b63d259f059cd15 and project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:47:46.347708 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-26e8a493-8260-47f1-925f-58f8427d609c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045654 May 12 17:47:46.348298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 358/713] 10.222.0.76 () {62 vars in 1199 bytes} [Thu May 12 17:47:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 17:47:46.735564 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:46.736389 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:46.742903 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:46.743360 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:46.744136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:46.744577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:46.877156 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:46.885234 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5f33d8c9-593c-41fa-9e7e-1fe3942338a5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.153586 May 12 17:47:46.885807 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 356/714] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:46 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:47.637717 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1381200835", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5ba6af5-8c03-4cd7-80fc-9b0f17cf03c5"}], "security_groups": [{"name": "tempest-securitygroup--1078571551"}], "key_name": "tempest-keypair-509714541", "user_data": "}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:47.737401 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] validate_networks() for [('c5ba6af5-8c03-4cd7-80fc-9b0f17cf03c5', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:47:47.902841 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:47.903444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:47.909935 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:47.910382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:47.911182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:47.911615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:48.046817 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.054950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b095dec4-374a-4818-9abe-ce7c88c41085 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.155943 May 12 17:47:48.055621 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 357/715] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:47 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:48.142703 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:47:48.143144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:47:48.143620 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:47:48.144029 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:47:48.144440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:47:48.153267 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:48.153718 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:48.154528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:48.155006 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:48.171330 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:47:48.175720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Getting quotas for user 10626535b6874ef58b63d259f059cd15 and project c07bc791aa8d45d4a9e72758f39f6a85. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:47:48.186397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:47:48.189338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:47:48.237855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e5802486-158c-480a-add0-b9bce6920275 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.601300 May 12 17:47:48.237855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 359/716] 10.222.0.76 () {62 vars in 1187 bytes} [Thu May 12 17:47:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 17:47:48.245416 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f8bc3331-2e51-41de-ae88-ee01308ac7f2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:48.245949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f8bc3331-2e51-41de-ae88-ee01308ac7f2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:48.299998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f8bc3331-2e51-41de-ae88-ee01308ac7f2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.306953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f8bc3331-2e51-41de-ae88-ee01308ac7f2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.308464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f8bc3331-2e51-41de-ae88-ee01308ac7f2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.309572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f8bc3331-2e51-41de-ae88-ee01308ac7f2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1281 microversion: 2.20 time: 0.068122 May 12 17:47:48.310140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 358/717] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:48 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:49.072867 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:49.073478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:49.080122 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.080571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.081341 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.081778 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.207727 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:49.215649 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-87154c4a-1642-447d-8c6c-1c5eb86a73db tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.146683 May 12 17:47:49.216217 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 360/718] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:49 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:49.389462 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:49.390633 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:49.399407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.400096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.401058 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.401494 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.473192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:49.481783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:49.484048 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:49.485577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-09590426-5d11-43d2-b1c1-0082ca60569a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1351 microversion: 2.20 time: 0.160866 May 12 17:47:49.486137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 359/719] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:49 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:50.234159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:50.235088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:50.245932 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:50.246490 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:50.247410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:50.247981 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:50.398903 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.408451 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-db5ff2e7-5f03-4344-b7b7-15899ca32e46 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.178648 May 12 17:47:50.418112 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 361/720] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:50 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:50.503900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:50.504618 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:50.511044 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:50.511501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:50.512276 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:50.512720 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:50.698086 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.706264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.707853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.708977 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-060e575a-b356-4ba9-9b3b-4ee78a0a11b5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.209686 May 12 17:47:50.718750 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 360/721] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:50 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:51.200533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-2bd6c612-08da-4d4a-bd0f-5250f0ba0795 req-e78379db-ed8c-4aa2-a0b5-3c8870208841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67972c22-858c-41e6-85f9-27327673af00", "tag": "143d4171-1885-4746-8f1e-a6334c3f41fe"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:51.209887 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2bd6c612-08da-4d4a-bd0f-5250f0ba0795 req-e78379db-ed8c-4aa2-a0b5-3c8870208841 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.210602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-2bd6c612-08da-4d4a-bd0f-5250f0ba0795 req-e78379db-ed8c-4aa2-a0b5-3c8870208841 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.233824 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-2bd6c612-08da-4d4a-bd0f-5250f0ba0795 req-e78379db-ed8c-4aa2-a0b5-3c8870208841 service nova] Creating event network-changed:143d4171-1885-4746-8f1e-a6334c3f41fe for instance 67972c22-858c-41e6-85f9-27327673af00 on hv-cinder-83979 May 12 17:47:51.239127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-2bd6c612-08da-4d4a-bd0f-5250f0ba0795 req-e78379db-ed8c-4aa2-a0b5-3c8870208841 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042732 May 12 17:47:51.240561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 362/722] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:51.426505 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:51.427147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:51.433118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.433576 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.434350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.434824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.637813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.645786 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6140c557-c926-41cd-9b81-234bc7aca265 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.223817 May 12 17:47:51.646641 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 361/723] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:51 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:51.728363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:51.729061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:51.735028 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.735551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.737111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.737559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.869880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.877698 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.879221 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.880312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6c8c441c-08fd-4b85-acdb-fe418d9866dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.156671 May 12 17:47:51.880877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 363/724] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:51 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:52.663548 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:52.664165 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:52.670506 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.670998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:52.671774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.672212 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:52.800500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:52.808673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b339a141-4918-4e91-a393-3128e136c651 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.149326 May 12 17:47:52.809240 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 362/725] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:52 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:52.899032 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:52.899565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:52.905853 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.906302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:52.907105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.907543 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:53.035364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:53.043286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:53.044778 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:53.045872 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a020d112-59e0-4d2b-ae9d-97429c4a369a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.151795 May 12 17:47:53.046423 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 364/726] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:52 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:53.825263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:53.825877 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:53.832949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:53.833409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:53.834212 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:53.834655 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:53.963709 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:53.971359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1f5257f5-7fe3-4a16-813e-fa4ed25a4b66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.149961 May 12 17:47:53.971921 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 363/727] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:53 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:54.063355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:54.063984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:54.070497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:54.070983 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:54.071793 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:54.072232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:54.202440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:54.211110 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:54.212593 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:54.213672 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3e1360dd-2902-461d-a619-93b88d719b97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.154245 May 12 17:47:54.214231 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 365/728] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:54 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:54.989716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:54.990350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:54.996567 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:54.997012 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:54.997778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:54.998204 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:55.133791 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.141526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8bc2f4e1-aa12-4ee0-836c-035276336e66 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.156147 May 12 17:47:55.142102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 364/729] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:54 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:55.232560 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:55.233688 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:55.240184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:55.240906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:55.241383 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:55.241816 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:55.369722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.377445 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.378986 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.380228 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ee3501c9-80d7-4591-a337-d240f81f9a80 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.151626 May 12 17:47:55.380808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 366/730] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:55 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:56.159950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:56.161292 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:56.167669 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.168126 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.168895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.169335 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.300444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.309495 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ac367a2f-f867-4a00-8292-552932f847f7 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.153354 May 12 17:47:56.310066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 365/731] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:56 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:56.397624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:56.398225 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:56.404504 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.404953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.405720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.406154 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.538114 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.545714 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.547233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.548352 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2c7c7146-83aa-4109-9853-bdfd0c23561c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.154982 May 12 17:47:56.548897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 367/732] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:56 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:57.164169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-f85e33a1-d6b7-4d6e-924c-f9032727d4c4 req-b71d4803-63e0-4dfb-964e-7fffff1e7bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67972c22-858c-41e6-85f9-27327673af00", "name": "network-vif-plugged", "status": "completed", "tag": "143d4171-1885-4746-8f1e-a6334c3f41fe"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:57.172816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-f85e33a1-d6b7-4d6e-924c-f9032727d4c4 req-b71d4803-63e0-4dfb-964e-7fffff1e7bc7 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.173269 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-f85e33a1-d6b7-4d6e-924c-f9032727d4c4 req-b71d4803-63e0-4dfb-964e-7fffff1e7bc7 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.185446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-f85e33a1-d6b7-4d6e-924c-f9032727d4c4 req-b71d4803-63e0-4dfb-964e-7fffff1e7bc7 service nova] Creating event network-vif-plugged:143d4171-1885-4746-8f1e-a6334c3f41fe for instance 67972c22-858c-41e6-85f9-27327673af00 on hv-cinder-83979 May 12 17:47:57.190693 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-f85e33a1-d6b7-4d6e-924c-f9032727d4c4 req-b71d4803-63e0-4dfb-964e-7fffff1e7bc7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030942 May 12 17:47:57.191294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 366/733] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:57.326640 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:57.327273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:57.334111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.334579 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.335347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.335779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.464716 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.472471 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0af931a2-7ca9-4b41-88ec-1e497a1f1756 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.149733 May 12 17:47:57.473601 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 368/734] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:57 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:57.568443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:57.569139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:57.575229 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.575683 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.576471 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.577011 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.704163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.712470 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.713969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.715101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c7be1882-9ae3-4995-8f84-696acdcbad97 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.151171 May 12 17:47:57.715658 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 367/735] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:57 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:58.490230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:58.490801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:58.497250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.497706 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:58.498472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.498936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:58.633345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:58.641124 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6aade283-0faa-4d18-ab2b-7269122cb629 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.154932 May 12 17:47:58.641682 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 369/736] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:58 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:58.732835 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:58.733447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:58.739922 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.740440 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:58.741161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.742116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:58.868261 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:58.875956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:58.877475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:58.878570 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b973e17b-a70f-49fe-9a86-9da0e5751dca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1407 microversion: 2.20 time: 0.149656 May 12 17:47:58.879159 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 368/737] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:58 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:59.658389 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:59.659114 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:59.665947 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:59.666403 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:59.667210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:59.667651 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:59.798454 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:59.806870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-647ef02d-bcd5-4411-958a-9ed4cab046b4 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.152309 May 12 17:47:59.807438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 370/738] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:47:59 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:59.897359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:59.898842 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:59.905189 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:59.905658 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:59.906430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:59.906905 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.036061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:00.043835 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:00.045349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:00.046576 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-77743cb4-08de-48bb-b8bf-0ec80a73ba94 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1599 microversion: 2.20 time: 0.153349 May 12 17:48:00.047112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 369/739] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:47:59 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:00.064191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7ef6b61c-fc92-4d53-a2da-926bb7bd2565 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:00.064683 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7ef6b61c-fc92-4d53-a2da-926bb7bd2565 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:00.071233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ef6b61c-fc92-4d53-a2da-926bb7bd2565 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.071694 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ef6b61c-fc92-4d53-a2da-926bb7bd2565 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.072465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ef6b61c-fc92-4d53-a2da-926bb7bd2565 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.072904 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ef6b61c-fc92-4d53-a2da-926bb7bd2565 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.148722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7ef6b61c-fc92-4d53-a2da-926bb7bd2565 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088312 May 12 17:48:00.149323 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 371/740] 10.222.0.76 () {60 vars in 1315 bytes} [Thu May 12 17:48:00 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:48:00.518318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f3af528a-f16b-45cb-abf0-33161fd44e7a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:00.518853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f3af528a-f16b-45cb-abf0-33161fd44e7a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:00.525481 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3af528a-f16b-45cb-abf0-33161fd44e7a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.525926 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3af528a-f16b-45cb-abf0-33161fd44e7a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.526718 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3af528a-f16b-45cb-abf0-33161fd44e7a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.527152 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f3af528a-f16b-45cb-abf0-33161fd44e7a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.552127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f3af528a-f16b-45cb-abf0-33161fd44e7a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/ips" status: 200 len: 148 microversion: 2.1 time: 0.134054 May 12 17:48:00.552896 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 370/741] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:48:00 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/ips => generated 148 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:00.825737 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:00.826525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:00.832195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.832665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.845049 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.845625 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:01.077796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:01.086659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-125034dd-59c0-4764-9594-614da955fd71 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.265526 May 12 17:48:01.087271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 372/742] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:00 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:01.243274 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-8f986de7-45e0-41e5-83f2-f6a71e297f1a req-c443e80c-54bb-4868-b228-79dfede9371d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67972c22-858c-41e6-85f9-27327673af00", "tag": "143d4171-1885-4746-8f1e-a6334c3f41fe"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:01.251898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-8f986de7-45e0-41e5-83f2-f6a71e297f1a req-c443e80c-54bb-4868-b228-79dfede9371d service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:01.252417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-8f986de7-45e0-41e5-83f2-f6a71e297f1a req-c443e80c-54bb-4868-b228-79dfede9371d service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:01.263839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-8f986de7-45e0-41e5-83f2-f6a71e297f1a req-c443e80c-54bb-4868-b228-79dfede9371d service nova] Creating event network-changed:143d4171-1885-4746-8f1e-a6334c3f41fe for instance 67972c22-858c-41e6-85f9-27327673af00 on hv-cinder-83979 May 12 17:48:01.268793 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-8f986de7-45e0-41e5-83f2-f6a71e297f1a req-c443e80c-54bb-4868-b228-79dfede9371d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029442 May 12 17:48:01.269474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 371/743] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:01.881534 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5fa29958-52e7-4049-89ec-a5da61f66be3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7c37bab-fd2a-48f8-9cf4-e19667aa2720"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:01.883749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5fa29958-52e7-4049-89ec-a5da61f66be3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:01.890073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa29958-52e7-4049-89ec-a5da61f66be3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:01.890616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa29958-52e7-4049-89ec-a5da61f66be3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:01.891479 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa29958-52e7-4049-89ec-a5da61f66be3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:01.891978 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fa29958-52e7-4049-89ec-a5da61f66be3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:02.107195 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:02.108183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:02.115579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:02.116030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:02.117003 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:02.117449 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:02.239021 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5fa29958-52e7-4049-89ec-a5da61f66be3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361220 May 12 17:48:02.240862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 373/744] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:48:01 2022] POST /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:02.340854 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:02.350484 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c837d15d-a59c-4d01-aa43-852e9ab67d8b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1734 microversion: 2.1 time: 0.249784 May 12 17:48:02.352936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 372/745] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:02 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1734 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:03.369938 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:03.370687 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:03.376864 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.377314 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.378078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.378519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.509748 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:03.518020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-06e5a422-b169-4dec-a8ff-555c3c784fe8 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1714 microversion: 2.1 time: 0.152497 May 12 17:48:03.518472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 374/746] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:03 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:03.623500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:03.624097 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:03.634873 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.635339 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.636153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.636593 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.716092 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] HTTP exception thrown: Cannot 'detach_volume' instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 while it is in vm_state rescued May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Request method failure captured: May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments/30d598e0-d2a9-46a8-98f8-b6e22a8a7b8b HTTP/1.1 May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUdSt7CuCtUuj1igLX403WPelXYYDhXrwsO_WFe9JIdu0Ze95DTlZWoLml0rwnxVW9-Oh59tmCNB6nEzSTue2tK2cUC1lGABUpQMzFwg4Bc_7pYb8bQT_-xcCJCGM1AkYtQj250Vp1sCL8Mmg8LNaK-Yn-UhT8sHeKHWRlQ2Kau6WsA May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:48:03.717647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bcee5099fd2b4df2adaa069af3a45733", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ee532b08897148dd9ff0482a00f537f7 May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:48:03.719275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Cannot 'detach_volume' instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 while it is in vm_state rescued May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'server_id': '0424abb5-9a1e-40d7-9293-6afed05d22a4', 'id': '30d598e0-d2a9-46a8-98f8-b6e22a8a7b8b'} May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:03.720098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 while it is in vm_state rescued May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 while it is in vm_state rescued May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:03.721605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Returning 409 to user: Cannot 'detach_volume' instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 while it is in vm_state rescued {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:03.722848 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d658e5a3-34c1-4e41-a968-d3039c50f461 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments/30d598e0-d2a9-46a8-98f8-b6e22a8a7b8b" status: 409 len: 152 microversion: 2.1 time: 0.099961 May 12 17:48:03.722848 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 373/747] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:48:03 2022] DELETE /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments/30d598e0-d2a9-46a8-98f8-b6e22a8a7b8b => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 17:48:03.728552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f163183b-4773-4776-a1ba-beb7270195a0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:03.729088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f163183b-4773-4776-a1ba-beb7270195a0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:03.735095 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f163183b-4773-4776-a1ba-beb7270195a0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.735549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f163183b-4773-4776-a1ba-beb7270195a0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.736351 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f163183b-4773-4776-a1ba-beb7270195a0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.736789 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f163183b-4773-4776-a1ba-beb7270195a0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.803571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f163183b-4773-4776-a1ba-beb7270195a0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "POST /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/action" status: 202 len: 0 microversion: 2.1 time: 0.079247 May 12 17:48:03.807788 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 375/748] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:48:03 2022] POST /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:48:03.813001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:03.813613 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:03.819663 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.820254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.820999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.821437 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:04.034339 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:04.042243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d86b96fb-e05c-4101-bbf2-d20a23e335dd tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1722 microversion: 2.1 time: 0.233036 May 12 17:48:04.042850 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 374/749] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:03 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:05.061247 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:05.061943 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:05.068045 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:05.068495 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:05.069258 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:05.070183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:05.200104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:05.207748 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-bbf1bc30-4586-4f7b-9e39-fbfd7da77fe5 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1722 microversion: 2.1 time: 0.151253 May 12 17:48:05.208310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 376/750] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:05 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:06.125077 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:06.125640 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:06.132441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.132905 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.133673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.134114 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.158413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:06.225323 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:06.226043 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:06.231046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ea55438a-7956-4541-a003-00237e6c4adb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "DELETE /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 204 len: 0 microversion: 2.1 time: 0.109370 May 12 17:48:06.231629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 375/751] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:48:06 2022] DELETE /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:48:06.232332 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.232793 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.233582 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.234026 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.241097 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:06.242457 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:06.248302 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.248756 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.249531 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.249965 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.384670 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:06.388833 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:06.392589 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-35b643f6-0378-4e03-919b-2332bb8efd9c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1722 microversion: 2.1 time: 0.171091 May 12 17:48:06.393160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 377/752] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:06 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:06.396690 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1db3a2e2-5e21-47f8-86ef-6f0afaffbaa3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1577 microversion: 2.1 time: 0.160221 May 12 17:48:06.397251 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 376/753] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:06 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:07.411290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:07.412150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:07.414827 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:07.415447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:07.419378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.419838 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.420624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.421061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.421890 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.422344 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.423142 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.423585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.552011 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:07.555476 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:07.563532 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-164e9d6a-aa0b-4dc0-a569-bbc836d06059 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1577 microversion: 2.1 time: 0.153090 May 12 17:48:07.565021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 377/754] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:07 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:07.565183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0604b5ec-72aa-49e5-aa9b-9f716339824b tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1722 microversion: 2.1 time: 0.156914 May 12 17:48:07.565183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 378/755] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:07 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:08.581302 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:08.581909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:08.585195 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:08.585780 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:08.589489 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.590142 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.590974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.591440 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.593917 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.594613 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.595664 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.596166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.737865 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:08.746302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f1a1a953-5eb7-4b16-a840-737a32e277dc tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1728 microversion: 2.1 time: 0.164891 May 12 17:48:08.747730 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 379/756] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:08 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:08.763510 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-55f36fcf-5808-48ec-88a2-047be8af7626 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:08.764005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-55f36fcf-5808-48ec-88a2-047be8af7626 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:08.769870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-55f36fcf-5808-48ec-88a2-047be8af7626 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.770315 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-55f36fcf-5808-48ec-88a2-047be8af7626 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.771144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-55f36fcf-5808-48ec-88a2-047be8af7626 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.771845 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-55f36fcf-5808-48ec-88a2-047be8af7626 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.817987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:08.825722 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f5870dd9-56de-4437-9428-af520d611d54 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1577 microversion: 2.1 time: 0.249177 May 12 17:48:08.826536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 378/757] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:08 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1577 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:08.853496 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-55f36fcf-5808-48ec-88a2-047be8af7626 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093046 May 12 17:48:08.854096 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 380/758] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:48:08 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:09.526593 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-ce5c26b9-c26d-4906-bd7c-a043c2e9c6f2 req-79dbe130-a742-4bc3-81b7-3e90d8c11b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a1ff6d-1105-476b-880e-39e5d783b0a2", "name": "network-vif-deleted", "tag": "aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:09.546795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ce5c26b9-c26d-4906-bd7c-a043c2e9c6f2 req-79dbe130-a742-4bc3-81b7-3e90d8c11b62 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:09.550228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ce5c26b9-c26d-4906-bd7c-a043c2e9c6f2 req-79dbe130-a742-4bc3-81b7-3e90d8c11b62 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:09.570105 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-ce5c26b9-c26d-4906-bd7c-a043c2e9c6f2 req-79dbe130-a742-4bc3-81b7-3e90d8c11b62 service nova] Creating event network-vif-deleted:aad3e23a-1df8-4942-b4f3-18f8fcf4e5d4 for instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 on hv-cinder-83979 May 12 17:48:09.576141 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-ce5c26b9-c26d-4906-bd7c-a043c2e9c6f2 req-79dbe130-a742-4bc3-81b7-3e90d8c11b62 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111564 May 12 17:48:09.577145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 379/759] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:09.842782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:09.844076 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:09.851042 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:09.852419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:09.853497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:09.854210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:09.963953 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:09.975773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ebbe2e75-af71-4766-a0d4-6f4a9f2fd23b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 200 len: 1224 microversion: 2.1 time: 0.136759 May 12 17:48:09.987064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 381/760] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:09 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:10.197814 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-ae9aafe8-31fc-4120-a3de-f5bd2a61bbcf req-41d4fd91-253d-43f3-bc1c-12f23c596e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0424abb5-9a1e-40d7-9293-6afed05d22a4", "tag": "e7bcf6a7-e3d8-42ac-93af-72139b9509fa"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:10.218106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ae9aafe8-31fc-4120-a3de-f5bd2a61bbcf req-41d4fd91-253d-43f3-bc1c-12f23c596e79 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:10.218736 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ae9aafe8-31fc-4120-a3de-f5bd2a61bbcf req-41d4fd91-253d-43f3-bc1c-12f23c596e79 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:10.231349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-ae9aafe8-31fc-4120-a3de-f5bd2a61bbcf req-41d4fd91-253d-43f3-bc1c-12f23c596e79 service nova] Creating event network-changed:e7bcf6a7-e3d8-42ac-93af-72139b9509fa for instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 on hv-cinder-83979 May 12 17:48:10.240354 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-ae9aafe8-31fc-4120-a3de-f5bd2a61bbcf req-41d4fd91-253d-43f3-bc1c-12f23c596e79 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047824 May 12 17:48:10.241689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 380/761] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:10.859560 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7c37bab-fd2a-48f8-9cf4-e19667aa2720"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:10.860935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:10.867555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:10.868090 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:10.869256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:10.869705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:10.951329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Invalid volume: volume d7c37bab-fd2a-48f8-9cf4-e19667aa2720 is already attached to instances: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: POST /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments HTTP/1.1 May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 74 May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:48:10.953265 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {"volumeAttachment": {"volumeId": "d7c37bab-fd2a-48f8-9cf4-e19667aa2720"}} May 12 17:48:10.955031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Invalid volume: volume d7c37bab-fd2a-48f8-9cf4-e19667aa2720 is already attached to instances: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'server_id': '8fd7e68e-d36e-4be7-83e3-e12e7df966b5', 'body': {'volumeAttachment': {'volumeId': 'd7c37bab-fd2a-48f8-9cf4-e19667aa2720'}}} May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d7c37bab-fd2a-48f8-9cf4-e19667aa2720 is already attached to instances: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:10.955915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d7c37bab-fd2a-48f8-9cf4-e19667aa2720 is already attached to instances: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:10.957237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d7c37bab-fd2a-48f8-9cf4-e19667aa2720 is already attached to instances: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 400 to user: Invalid volume: volume d7c37bab-fd2a-48f8-9cf4-e19667aa2720 is already attached to instances: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3044969e-259b-4be7-9048-d8f2c540fb4b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100839 May 12 17:48:10.958583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 382/762] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:48:10 2022] POST /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:48:10.994490 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:10.995224 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:11.001307 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.001761 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.009624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.010294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.018253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:11.018963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:11.025891 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] HTTP exception thrown: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:48:11.026545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.027021 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Request method failure captured: May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 HTTP/1.1 May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUdrJ391YR7XyDmG4-sRSiCeHMnXU_QmSYzk5bNRNXzdx9CzUlKhghKMNOq52Z428RJqED_5A3D8fvmJc-ZqT8wv_EPtIOHX1fkKyAQ4WlVajLVpijqCXn9LwovVG47dzcHQxXNHf4GjCnZnviES9-dOMFwJvOgXIxITgGPh1DVY5qo May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:48:11.028364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4e9154d1a4c44c6b8a42001c659d069b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-TestVolumeBootPattern-386813284 May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-TestVolumeBootPattern-386813284-project May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 7802c329d4ca4eccb28fdec9f8082cc1 May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-TestVolumeBootPattern-386813284-project May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:48:11.029657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '58a1ff6d-1105-476b-880e-39e5d783b0a2'} May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:11.031314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:48:11.032483 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:11.033590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.033590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.033734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Returning 404 to user: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:11.033734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4b57a9f7-c2f7-48dc-8eca-4cca9199cd46 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 404 len: 111 microversion: 2.1 time: 0.039669 May 12 17:48:11.033734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 381/763] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:10 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:48:11.118856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lazy-loading 'services' on Instance uuid 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:11.191219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2038694580", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235511178", "security_groups": [{"name": "tempest-secgroup-smoke-1268337681"}], "block_device_mapping_v2": [{"uuid": "abe30758-795c-4b5b-aa34-27248b9f75f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb76e15-efb3-4276-8531-f3adac3a6ec1"}]}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:11.206284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-64a45d4d-87c2-4102-bc5c-3892d44a8d92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments/d7c37bab-fd2a-48f8-9cf4-e19667aa2720" status: 202 len: 0 microversion: 2.1 time: 0.191983 May 12 17:48:11.207247 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 383/764] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:48:11 2022] DELETE /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments/d7c37bab-fd2a-48f8-9cf4-e19667aa2720 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:48:11.217170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-73050ae4-8fb9-4e64-ab41-9a123da941c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:11.218571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-73050ae4-8fb9-4e64-ab41-9a123da941c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:11.225785 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73050ae4-8fb9-4e64-ab41-9a123da941c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.227150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73050ae4-8fb9-4e64-ab41-9a123da941c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.231517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73050ae4-8fb9-4e64-ab41-9a123da941c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.232596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73050ae4-8fb9-4e64-ab41-9a123da941c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.271216 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-73050ae4-8fb9-4e64-ab41-9a123da941c1 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058861 May 12 17:48:11.272524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 384/765] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:48:11 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:11.361409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] validate_networks() for [('3cb76e15-efb3-4276-8531-f3adac3a6ec1', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:48:11.757403 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:48:11.758056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:48:11.758563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:48:11.759024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:48:11.759436 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:48:11.768193 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.768634 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.769426 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.769862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.786997 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:11.791635 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for user 7802c329d4ca4eccb28fdec9f8082cc1 and project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:11.848907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:48:11.851225 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abe30758-795c-4b5b-aa34-27248b9f75f6',volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:48:11.978856 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8147bf11-b46e-4eb1-a03d-08af76fc5eb6 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791779 May 12 17:48:11.979508 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 382/766] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:48:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:48:11.989574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8606312d-9660-46d9-ac16-203dd25f1178 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:11.990267 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8606312d-9660-46d9-ac16-203dd25f1178 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:12.048133 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8606312d-9660-46d9-ac16-203dd25f1178 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:12.056139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8606312d-9660-46d9-ac16-203dd25f1178 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1094 microversion: 2.1 time: 0.069787 May 12 17:48:12.057816 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 385/767] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:11 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:12.255033 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-c07922f5-27a3-4aa8-b1cd-b3bf685747c1 req-58a81948-9995-4456-85c1-770f63319141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0424abb5-9a1e-40d7-9293-6afed05d22a4", "tag": "e7bcf6a7-e3d8-42ac-93af-72139b9509fa"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:12.265030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-c07922f5-27a3-4aa8-b1cd-b3bf685747c1 req-58a81948-9995-4456-85c1-770f63319141 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.265552 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-c07922f5-27a3-4aa8-b1cd-b3bf685747c1 req-58a81948-9995-4456-85c1-770f63319141 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.276761 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-c07922f5-27a3-4aa8-b1cd-b3bf685747c1 req-58a81948-9995-4456-85c1-770f63319141 service nova] Creating event network-changed:e7bcf6a7-e3d8-42ac-93af-72139b9509fa for instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 on hv-cinder-83979 May 12 17:48:12.281779 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-c07922f5-27a3-4aa8-b1cd-b3bf685747c1 req-58a81948-9995-4456-85c1-770f63319141 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030663 May 12 17:48:12.282767 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 383/768] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:12.285120 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0ebf5b46-1d05-4599-a8fc-d70679b5f7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:12.286251 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0ebf5b46-1d05-4599-a8fc-d70679b5f7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:12.296063 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ebf5b46-1d05-4599-a8fc-d70679b5f7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.296524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ebf5b46-1d05-4599-a8fc-d70679b5f7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.297310 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ebf5b46-1d05-4599-a8fc-d70679b5f7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.298808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ebf5b46-1d05-4599-a8fc-d70679b5f7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.339376 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0ebf5b46-1d05-4599-a8fc-d70679b5f7b4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059854 May 12 17:48:12.339957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 386/769] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:48:12 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 17:48:12.404191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:12.405070 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:12.413133 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.413594 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.414387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.414846 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.442481 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:12.532801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-08d35039-ba3b-43d4-b278-058024286442 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 204 len: 0 microversion: 2.1 time: 0.132210 May 12 17:48:12.536697 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 384/770] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:48:12 2022] DELETE /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:48:12.543436 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:12.544363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:12.551228 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.551767 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.552632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.553165 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.686083 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:12.693355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a239880c-ad05-42cd-92c9-c9e3a01f4f92 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1680 microversion: 2.1 time: 0.155458 May 12 17:48:12.693948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 387/771] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:12 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:13.074320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:13.075042 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:13.080949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.081406 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.082172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.082611 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.145157 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:13.153288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-69881889-a7fd-45c0-a756-030eaca7ffe9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1192 microversion: 2.1 time: 0.083438 May 12 17:48:13.153862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 385/772] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:13 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:13.710619 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:13.711288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:13.717631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.718087 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.718894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.719343 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.851131 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:13.858685 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6907fd77-4209-4a42-ac20-87cc2892f6cc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1680 microversion: 2.1 time: 0.151938 May 12 17:48:13.859335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 388/773] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:13 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:14.170374 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:14.171042 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:14.177320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:14.177771 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:14.178536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:14.178996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:14.241642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:14.249717 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6a5e7208-993c-4b84-9e32-8e937863a01d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1192 microversion: 2.1 time: 0.083325 May 12 17:48:14.250278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 386/774] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:14 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:14.877602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:14.878527 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:14.885702 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:14.886154 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:14.886966 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:14.887405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:15.240999 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:15.250999 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-10924644-3ca1-4afa-a143-e22ec7245103 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1680 microversion: 2.1 time: 0.377598 May 12 17:48:15.251908 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 389/775] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:14 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1680 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:15.266286 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:15.267097 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:15.274359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:15.275202 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:15.276270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:15.276908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:15.343477 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:15.350819 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-37297fa6-71c8-4a4e-9d24-73567333e537 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1210 microversion: 2.1 time: 0.088437 May 12 17:48:15.351387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 387/776] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:15 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:16.215122 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-5484508c-a024-4f85-926a-9b355e5a02e2 req-4c220472-e032-4cb0-83a3-6f06987f5326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7e68e-d36e-4be7-83e3-e12e7df966b5", "name": "network-vif-deleted", "tag": "bd6a624b-c038-4a0f-9ac2-0c9196600d48"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:16.231390 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-5484508c-a024-4f85-926a-9b355e5a02e2 req-4c220472-e032-4cb0-83a3-6f06987f5326 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:16.231832 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-5484508c-a024-4f85-926a-9b355e5a02e2 req-4c220472-e032-4cb0-83a3-6f06987f5326 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:16.269004 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-5484508c-a024-4f85-926a-9b355e5a02e2 req-4c220472-e032-4cb0-83a3-6f06987f5326 service nova] Creating event network-vif-deleted:bd6a624b-c038-4a0f-9ac2-0c9196600d48 for instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 on hv-cinder-83979 May 12 17:48:16.269579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:16.270190 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:16.274660 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-5484508c-a024-4f85-926a-9b355e5a02e2 req-4c220472-e032-4cb0-83a3-6f06987f5326 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194957 May 12 17:48:16.275898 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 390/777] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:16.294364 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:16.295160 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:16.296093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:16.296714 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:16.340716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:16.341132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:16.341577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lazy-loading 'fault' on Instance uuid 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:16.372308 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:16.373344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:16.381574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:16.382330 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:16.384656 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:16.385409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:16.391116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:16.402286 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5da4a151-5fe1-497f-8c8e-c49525d10206 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 200 len: 1331 microversion: 2.1 time: 0.136659 May 12 17:48:16.406775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 388/778] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:16 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:16.634325 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:16.643707 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f4e76b6b-e901-47ce-bc17-d5ce2c5ee171 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.277246 May 12 17:48:16.654178 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 391/779] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:16 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:17.420559 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:17.421094 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:17.427334 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:17.427776 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:17.428560 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:17.428989 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:17.442213 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 HTTP/1.1 May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:48:17.443859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:48:17.445405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '8fd7e68e-d36e-4be7-83e3-e12e7df966b5'} May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:17.446260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:48:17.447679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:48:17.449027 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:17.449027 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3bc81c1d-cbd0-435d-afdb-2e70f2e108ba tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 404 len: 111 microversion: 2.1 time: 0.028949 May 12 17:48:17.449027 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 389/780] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:17 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:48:17.454629 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f3eddf7a-e71b-494c-ab62-46be9ad29f9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '.version_select at 0x7f24bc1b3550>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:17.472266 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f3eddf7a-e71b-494c-ab62-46be9ad29f9f tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077573384" status: 202 len: 0 microversion: 2.1 time: 0.021274 May 12 17:48:17.472833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 392/781] 10.222.0.76 () {58 vars in 1220 bytes} [Thu May 12 17:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077573384 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:48:17.660790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:17.661665 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:17.668270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:17.668726 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:17.669699 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:17.670303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:17.889312 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:17.896867 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8b660d3b-49b1-462b-a284-6e90a61bfca9 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.239607 May 12 17:48:17.897426 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 390/782] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:17 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:18.153366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f9570375-48c6-49f5-b65d-7f7f054aa060 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: .version_select at 0x7f24bc29ec10>, body: {"keypair": {"name": "tempest-keypair-614743144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dtgxJjOShkYP6hoXbj2OHm9BV+DwyyxBP8JsQWNk7izGWRAzFNRZpaYemZv5APm/AT3wgJ2OC+Ge8Vu+/TQsG+xThww9wLhC6jdvAH3NOlwyVc6djqymkpCTP1raiGg=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:18.168291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-f9570375-48c6-49f5-b65d-7f7f054aa060 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:18.172064 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-f9570375-48c6-49f5-b65d-7f7f054aa060 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:18.193214 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f9570375-48c6-49f5-b65d-7f7f054aa060 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043867 May 12 17:48:18.193800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 393/783] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:48:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:18.293145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-c558cae8-2c95-4e82-9abd-667a32e72132 req-0d13aa68-b48e-4732-9953-a71b837f566a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5", "tag": "fac993c6-5c0c-429d-9df1-25372f4535e2"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:18.301741 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-c558cae8-2c95-4e82-9abd-667a32e72132 req-0d13aa68-b48e-4732-9953-a71b837f566a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:18.302192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-c558cae8-2c95-4e82-9abd-667a32e72132 req-0d13aa68-b48e-4732-9953-a71b837f566a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:18.313620 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-c558cae8-2c95-4e82-9abd-667a32e72132 req-0d13aa68-b48e-4732-9953-a71b837f566a service nova] Creating event network-changed:fac993c6-5c0c-429d-9df1-25372f4535e2 for instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 on hv-cinder-83979 May 12 17:48:18.319349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-c558cae8-2c95-4e82-9abd-667a32e72132 req-0d13aa68-b48e-4732-9953-a71b837f566a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031179 May 12 17:48:18.320421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 391/784] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:18.914875 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:18.915556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:18.921512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:18.921968 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:18.922768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:18.923206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:19.210316 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:19.218557 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9adb47ce-29c1-42ea-a5a8-9239f29133ef tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.308877 May 12 17:48:19.219378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 394/785] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:18 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:20.010764 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1066939666", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f0e5ba6-f1dc-4741-a091-633af3cfbec5"}], "security_groups": [{"name": "tempest-securitygroup--1335176631"}], "key_name": "tempest-keypair-614743144", "user_data": "}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:20.111046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] validate_networks() for [('5f0e5ba6-f1dc-4741-a091-633af3cfbec5', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:48:20.236335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:20.237153 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:20.244714 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:20.245164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:20.245941 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:20.246371 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:20.381671 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:20.389164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c968b65d-84ec-48b9-b613-4fc75714ecf8 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.157346 May 12 17:48:20.389741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 395/786] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:20 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:20.478582 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:48:20.479034 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:48:20.479505 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:48:20.479911 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:48:20.480320 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:48:20.488796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:20.489243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:20.490076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:20.490511 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:20.506482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:20.510380 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Getting quotas for user ac1708b4ee7e43afaac75452be3b195e and project 38aae8b9be064fabb6e07ea34a5dcdb9. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:20.520873 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:48:20.523996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:48:20.570744 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-edcb6eb6-102e-448b-9a46-1e962027dfa4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564780 May 12 17:48:20.571104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 392/787] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:48:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:48:20.581019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e51ba66b-f092-43b3-bbe0-384a2b1c089b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:20.581626 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e51ba66b-f092-43b3-bbe0-384a2b1c089b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:20.639523 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e51ba66b-f092-43b3-bbe0-384a2b1c089b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:20.646179 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e51ba66b-f092-43b3-bbe0-384a2b1c089b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1241 microversion: 2.1 time: 0.068785 May 12 17:48:20.647037 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 396/788] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:20 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:21.407178 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:21.407788 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:21.414808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:21.415264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:21.416036 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:21.416471 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:21.551458 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:21.561098 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-00142353-ec00-46b4-8a1c-4656ea6c66ba tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.158208 May 12 17:48:21.562717 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 393/789] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:21 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:21.663254 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:21.663786 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:21.671306 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:21.672049 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:21.672880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:21.673355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:21.750161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:21.757465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ad4186a3-4733-4ab0-8d83-0e6d77015386 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1299 microversion: 2.1 time: 0.098205 May 12 17:48:21.758096 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 397/790] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:21 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:22.577685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:22.578296 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:22.585118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:22.585572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:22.586933 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:22.587376 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:22.729654 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:22.737930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cd10aee0-e3a4-46ef-8949-515c499536aa tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.164078 May 12 17:48:22.748070 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 394/791] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:22 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:22.775949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:22.776810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:22.784774 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:22.785281 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:22.786311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:22.787112 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:22.986488 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:22.995462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-51d499aa-3705-4cf5-b0b3-14dfbc733f7b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.224311 May 12 17:48:22.996221 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 398/792] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:22 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:23.038026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-4e3922a9-3da7-4df4-bace-dfc840b20a90 req-8dd8c99e-0b7a-4deb-8b6e-edd9200d8824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1dbd33a-296d-424f-931d-cbf3fb15edca", "tag": "43cef85c-a437-458e-8aca-ac2d59280f87"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:23.046589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-4e3922a9-3da7-4df4-bace-dfc840b20a90 req-8dd8c99e-0b7a-4deb-8b6e-edd9200d8824 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:23.047071 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-4e3922a9-3da7-4df4-bace-dfc840b20a90 req-8dd8c99e-0b7a-4deb-8b6e-edd9200d8824 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:23.058559 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-4e3922a9-3da7-4df4-bace-dfc840b20a90 req-8dd8c99e-0b7a-4deb-8b6e-edd9200d8824 service nova] Creating event network-changed:43cef85c-a437-458e-8aca-ac2d59280f87 for instance d1dbd33a-296d-424f-931d-cbf3fb15edca on hv-cinder-83979 May 12 17:48:23.064145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-4e3922a9-3da7-4df4-bace-dfc840b20a90 req-8dd8c99e-0b7a-4deb-8b6e-edd9200d8824 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029693 May 12 17:48:23.065305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 395/793] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:23.755494 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:23.756103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:23.762697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:23.763149 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:23.763935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:23.764369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:23.941337 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:23.949971 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5b9e2ff5-6237-4b03-b072-fa5029090dde tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.198303 May 12 17:48:23.950555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 399/794] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:23 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:24.012768 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:24.013493 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:24.020063 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.020517 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:24.021292 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.021998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:24.150513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:24.157740 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-61b3263d-0c32-4853-bbf4-7f567c19e738 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.149832 May 12 17:48:24.158690 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 396/795] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:24 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:24.967097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:24.967756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:24.974099 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.974553 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:24.975364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.975806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:25.106438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:25.113631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-61180a02-51c3-47a4-950f-5b86021c3033 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.150362 May 12 17:48:25.114638 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 400/796] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:24 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:25.174615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:25.175249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:25.182325 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:25.182801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:25.183574 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:25.184014 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:25.319523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:25.327551 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f6bcae4c-5e5f-4ed9-871a-05dbd64de46e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.156831 May 12 17:48:25.328121 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 397/797] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:25 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:26.131370 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:26.131984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:26.138922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:26.139380 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:26.140156 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:26.140631 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:26.271968 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:26.279483 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-12ef8383-5f49-40db-8244-86902fe23d3e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.152023 May 12 17:48:26.280051 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 401/798] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:26 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:26.345275 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:26.345885 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:26.352245 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:26.352725 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:26.353491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:26.353931 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:26.479952 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:26.487412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cc58cc04-1d46-4fc8-9757-95622aac89a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.145940 May 12 17:48:26.487991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 398/799] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:26 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:27.297671 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:27.298405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:27.305175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:27.306147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:27.306582 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:27.307053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:27.442968 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:27.451404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-26c5e10c-ef64-4b62-a273-c37109bae812 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.157644 May 12 17:48:27.451972 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 402/800] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:27 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:27.504998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:27.505628 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:27.512802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:27.513249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:27.514311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:27.514778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:27.629025 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-a760a220-6c81-46cb-b9f9-104e5cb6f540 req-88ae959d-e901-4ed1-ab4f-32132a411015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5", "name": "network-vif-plugged", "status": "completed", "tag": "fac993c6-5c0c-429d-9df1-25372f4535e2"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:27.640722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a760a220-6c81-46cb-b9f9-104e5cb6f540 req-88ae959d-e901-4ed1-ab4f-32132a411015 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:27.641134 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a760a220-6c81-46cb-b9f9-104e5cb6f540 req-88ae959d-e901-4ed1-ab4f-32132a411015 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:27.654163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-a760a220-6c81-46cb-b9f9-104e5cb6f540 req-88ae959d-e901-4ed1-ab4f-32132a411015 service nova] Creating event network-vif-plugged:fac993c6-5c0c-429d-9df1-25372f4535e2 for instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 on hv-cinder-83979 May 12 17:48:27.659371 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:27.661193 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-a760a220-6c81-46cb-b9f9-104e5cb6f540 req-88ae959d-e901-4ed1-ab4f-32132a411015 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096094 May 12 17:48:27.662144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 403/801] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:27.667820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-27851501-2d7e-4425-9f71-602ddde9e6d8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.166604 May 12 17:48:27.668554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 399/802] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:27 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:28.469206 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:28.469906 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:28.476493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:28.476946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:28.478412 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:28.478889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:28.609548 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:28.616836 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3c91fbe3-a7b3-4669-8996-85e160474146 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.151861 May 12 17:48:28.617400 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 404/803] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:28 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:28.684463 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:28.685073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:28.691404 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:28.691854 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:28.692622 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:28.693060 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:28.821581 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:28.828774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2d1409dc-46ce-4b93-b721-8cdf41919efb tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.148241 May 12 17:48:28.829346 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 400/804] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:28 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:29.633568 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:29.634181 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:29.640538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:29.641016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:29.641788 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:29.642274 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:29.675497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-461887e3-cb37-4580-b5b7-24044642657c req-3fbabcd9-3d50-4e7f-83d5-14db3352d7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1dbd33a-296d-424f-931d-cbf3fb15edca", "name": "network-vif-plugged", "status": "completed", "tag": "43cef85c-a437-458e-8aca-ac2d59280f87"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:29.684892 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-461887e3-cb37-4580-b5b7-24044642657c req-3fbabcd9-3d50-4e7f-83d5-14db3352d7eb service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:29.685531 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-461887e3-cb37-4580-b5b7-24044642657c req-3fbabcd9-3d50-4e7f-83d5-14db3352d7eb service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:29.698529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-461887e3-cb37-4580-b5b7-24044642657c req-3fbabcd9-3d50-4e7f-83d5-14db3352d7eb service nova] Creating event network-vif-plugged:43cef85c-a437-458e-8aca-ac2d59280f87 for instance d1dbd33a-296d-424f-931d-cbf3fb15edca on hv-cinder-83979 May 12 17:48:29.703580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-461887e3-cb37-4580-b5b7-24044642657c req-3fbabcd9-3d50-4e7f-83d5-14db3352d7eb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 May 12 17:48:29.704245 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 401/805] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:29.775881 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:29.783728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-075919cf-2b72-4e8c-aa4d-692bbb20baa1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1266 microversion: 2.1 time: 0.153929 May 12 17:48:29.784259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 405/806] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:29 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:29.845635 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:29.846312 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:29.853379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:29.853827 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:29.854585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:29.855039 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.006236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:30.014088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d64a4a32-5a21-48af-92b7-4e78d2e4a4d5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.172522 May 12 17:48:30.014689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 402/807] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:29 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:30.696771 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-49953a67-518e-4817-a792-8613def980d2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:30.697693 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-49953a67-518e-4817-a792-8613def980d2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:30.704007 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49953a67-518e-4817-a792-8613def980d2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.704462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49953a67-518e-4817-a792-8613def980d2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.705241 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49953a67-518e-4817-a792-8613def980d2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.705672 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-49953a67-518e-4817-a792-8613def980d2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.734021 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-49953a67-518e-4817-a792-8613def980d2 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041576 May 12 17:48:30.734486 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 406/808] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:48:30 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:48:30.791615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:30.792132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:30.798479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.798955 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.799723 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.800155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.801032 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:30.801648 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:30.808251 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.808708 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.809481 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.809920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.826167 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:30.902147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6dd5b69f-c951-4ba3-991e-279c7544dddd tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 204 len: 0 microversion: 2.1 time: 0.114353 May 12 17:48:30.902780 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 403/809] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:48:30 2022] DELETE /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:48:30.911177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:30.911869 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:30.918188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.918641 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.919442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.919875 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.942829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:30.950896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6ebb325a-690e-47b4-a534-4c6d4fcc21f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1454 microversion: 2.1 time: 0.153550 May 12 17:48:30.951471 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 407/810] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:30 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:30.966885 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:30.967493 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:30.973266 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.973715 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.974487 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.975330 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.051754 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:31.059839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d53f0dd8-be72-4bdd-9abb-671c7b7e990d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1674 microversion: 2.1 time: 0.152599 May 12 17:48:31.060421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 404/811] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:30 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:31.064795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:31.065395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:31.072155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.072609 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.073391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.073836 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.115575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:31.124127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b553fee8-f10d-4db4-b45f-4d83360f88b1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1454 microversion: 2.1 time: 0.160535 May 12 17:48:31.124705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 408/812] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:30 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:31.205668 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:31.213694 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-350767c5-4b39-4f80-b3b5-a68e52166218 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1367 microversion: 2.1 time: 0.152287 May 12 17:48:31.214268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 405/813] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:31 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:32.077858 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:32.078509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:32.085260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.085719 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.086596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.087070 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.237584 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:32.238259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:32.247656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.248229 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.249223 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.249586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.315934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:32.324857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-520df166-05c7-4f92-8df1-c19154fde9c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1674 microversion: 2.1 time: 0.250814 May 12 17:48:32.325452 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 409/814] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:32 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:32.381490 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:32.390739 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6a0be59c-ded7-441b-b9ce-a20a4b9495a4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1557 microversion: 2.1 time: 0.157686 May 12 17:48:32.391646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 406/815] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:32 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:32.408437 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-89184e0c-262c-4bed-97ec-f47d3d27a59d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:32.408929 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-89184e0c-262c-4bed-97ec-f47d3d27a59d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:32.415042 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89184e0c-262c-4bed-97ec-f47d3d27a59d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.415652 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89184e0c-262c-4bed-97ec-f47d3d27a59d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.416432 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89184e0c-262c-4bed-97ec-f47d3d27a59d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.416868 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89184e0c-262c-4bed-97ec-f47d3d27a59d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.532382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-89184e0c-262c-4bed-97ec-f47d3d27a59d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127993 May 12 17:48:32.533077 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 410/816] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:48:32 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:33.295109 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-daed3ee7-a088-4bb7-ae06-dc14bd27e5b0 req-9428dfae-9626-4672-9c20-8020d67b1cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5", "tag": "fac993c6-5c0c-429d-9df1-25372f4535e2"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:33.304498 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-daed3ee7-a088-4bb7-ae06-dc14bd27e5b0 req-9428dfae-9626-4672-9c20-8020d67b1cfa service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.308907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-daed3ee7-a088-4bb7-ae06-dc14bd27e5b0 req-9428dfae-9626-4672-9c20-8020d67b1cfa service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.329351 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-daed3ee7-a088-4bb7-ae06-dc14bd27e5b0 req-9428dfae-9626-4672-9c20-8020d67b1cfa service nova] Creating event network-changed:fac993c6-5c0c-429d-9df1-25372f4535e2 for instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 on hv-cinder-83979 May 12 17:48:33.334706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-daed3ee7-a088-4bb7-ae06-dc14bd27e5b0 req-9428dfae-9626-4672-9c20-8020d67b1cfa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044802 May 12 17:48:33.335907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 407/817] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:33.342618 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:33.343809 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:33.362915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.364146 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.364952 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.365564 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.701514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:33.713056 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-067a0688-8237-4b81-8779-ab2cd731b33f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1674 microversion: 2.1 time: 0.372772 May 12 17:48:33.723882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 411/818] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:33 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1674 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:33.819753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-ada96746-8e85-4c8b-9a16-55115b52625b req-057afd43-0b0e-4487-9cad-354342f944e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1dbd33a-296d-424f-931d-cbf3fb15edca", "tag": "43cef85c-a437-458e-8aca-ac2d59280f87"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:33.829685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ada96746-8e85-4c8b-9a16-55115b52625b req-057afd43-0b0e-4487-9cad-354342f944e8 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.830148 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ada96746-8e85-4c8b-9a16-55115b52625b req-057afd43-0b0e-4487-9cad-354342f944e8 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.842971 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-ada96746-8e85-4c8b-9a16-55115b52625b req-057afd43-0b0e-4487-9cad-354342f944e8 service nova] Creating event network-changed:43cef85c-a437-458e-8aca-ac2d59280f87 for instance d1dbd33a-296d-424f-931d-cbf3fb15edca on hv-cinder-83979 May 12 17:48:33.848152 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-ada96746-8e85-4c8b-9a16-55115b52625b req-057afd43-0b0e-4487-9cad-354342f944e8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032736 May 12 17:48:33.853257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 408/819] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:34.731983 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:34.732687 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:34.739775 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:34.740338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:34.741188 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:34.741705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:34.775918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:34.776632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:34.777089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lazy-loading 'fault' on Instance uuid a92a89c3-a796-4a8b-9491-3f944bca5a9b {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:34.818270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:34.826398 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d20b5a5e-d8ea-4e5f-87e6-dd748db8f4cf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 200 len: 1327 microversion: 2.1 time: 0.100520 May 12 17:48:34.827461 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 412/820] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:34 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:35.352920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-a4860397-c851-4f84-a435-2ea36a196553 req-55f384fa-7b68-4d1a-aba8-0c26e6fa9328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92a89c3-a796-4a8b-9491-3f944bca5a9b", "name": "network-vif-deleted", "tag": "dae83d1a-12ad-4d98-a4d1-13233ca983ae"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:35.361754 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-a4860397-c851-4f84-a435-2ea36a196553 req-55f384fa-7b68-4d1a-aba8-0c26e6fa9328 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.362107 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-a4860397-c851-4f84-a435-2ea36a196553 req-55f384fa-7b68-4d1a-aba8-0c26e6fa9328 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.375818 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-a4860397-c851-4f84-a435-2ea36a196553 req-55f384fa-7b68-4d1a-aba8-0c26e6fa9328 service nova] Creating event network-vif-deleted:dae83d1a-12ad-4d98-a4d1-13233ca983ae for instance a92a89c3-a796-4a8b-9491-3f944bca5a9b on hv-cinder-83979 May 12 17:48:35.380806 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-a4860397-c851-4f84-a435-2ea36a196553 req-55f384fa-7b68-4d1a-aba8-0c26e6fa9328 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032747 May 12 17:48:35.381424 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 409/821] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:35.843832 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:35.844435 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:35.851107 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.851581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.853012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.853405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.867350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] HTTP exception thrown: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Request method failure captured: May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b HTTP/1.1 May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcbOAvocbyxh19Uf1MsLEvq6GyynAVphigXsygy3FqJyYC3X_ERgDXwsqQcznpwPLyJQyC9qLznzJ98iVl6sooHDBmRAu-H6oGJlCnt5_rjHftRs8hj1-EN25ZlVyJt06fTFzGqk8bkTDe8kQFs_L7CJuhQ_jA6wAvVFut2OLaHaMg May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:48:35.869819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bf607837a27e47bf99a32b3b095df070", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeTestJSON-1657542953 May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: d8866c723166455a9711559eb7f125c4 May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:48:35.871465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'a92a89c3-a796-4a8b-9491-3f944bca5a9b'} May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:35.872528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:48:35.874097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:35.875677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Returning 404 to user: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:35.875677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-326acddf-006d-4409-a150-9f7e02e1660f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 404 len: 111 microversion: 2.1 time: 0.031291 May 12 17:48:35.875677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 413/822] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:35 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:48:35.881141 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0283bdb0-76af-4a25-bad7-1123ff2cdd3b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '.version_select at 0x7f24bc0fc0d0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:35.900622 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0283bdb0-76af-4a25-bad7-1123ff2cdd3b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381943331" status: 202 len: 0 microversion: 2.1 time: 0.023794 May 12 17:48:35.901213 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 410/823] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 12 17:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381943331 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:48:36.762557 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3c223ea1-d1a6-435f-99f1-51bbb5bbbf82 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'create', calling method: .version_select at 0x7f24bc1e5a60>, body: {"keypair": {"name": "tempest-keypair-1359779797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSQ0vO7ibn09dwTSuvbUUwd02M/4WM11dqPSGjzcqJ2JNoiS7HjsAYMzhmRzsbXzwxP0kQoYFvIcrL5tx/5Fth6wb6I4iOFepXOulxKZ/wvkjYnd6RSoGomIYZPWyQqnw=="}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:36.777123 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-3c223ea1-d1a6-435f-99f1-51bbb5bbbf82 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for project bf607837a27e47bf99a32b3b095df070. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:36.780923 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-3c223ea1-d1a6-435f-99f1-51bbb5bbbf82 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for user d8866c723166455a9711559eb7f125c4 and project bf607837a27e47bf99a32b3b095df070. Resources: {'key_pairs'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:36.803056 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3c223ea1-d1a6-435f-99f1-51bbb5bbbf82 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044942 May 12 17:48:36.803681 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 414/824] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:48:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:38.165367 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1988637849", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16b8cd17-5204-4534-ab3e-f50d37e56b44"}], "security_groups": [{"name": "tempest-securitygroup--781906224"}], "key_name": "tempest-keypair-1359779797", "user_data": "}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:38.275482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.network.neutron [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] validate_networks() for [('16b8cd17-5204-4534-ab3e-f50d37e56b44', None, None, None, None, None)] {{(pid=123689) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:48:38.637852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Flavor limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:48:38.638278 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Image limits 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:48:38.638814 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Flavor pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:48:38.639230 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Image pref 0:0:0 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:48:38.639643 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.virt.hardware [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:48:38.648579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:38.650007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:38.650529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:38.650997 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:38.667281 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for project bf607837a27e47bf99a32b3b095df070. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:38.671146 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Getting quotas for user d8866c723166455a9711559eb7f125c4 and project bf607837a27e47bf99a32b3b095df070. Resources: {'cores', 'instances', 'ram'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:38.682190 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Going to run 1 instances... {{(pid=123689) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:48:38.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:48:38.731697 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ebbe0e4b-d01f-4a07-a1bb-30513218f143 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573289 May 12 17:48:38.732365 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 411/825] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:48:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:48:38.743165 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-87835f09-abb0-41d4-8aba-5813cdf2c5f1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:38.744100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-87835f09-abb0-41d4-8aba-5813cdf2c5f1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:38.797291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-87835f09-abb0-41d4-8aba-5813cdf2c5f1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:38.803910 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-87835f09-abb0-41d4-8aba-5813cdf2c5f1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1238 microversion: 2.1 time: 0.065168 May 12 17:48:38.804558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 415/826] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:38 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:39.821581 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:39.822346 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:39.829838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:39.830296 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:39.831128 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:39.831552 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:39.897756 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:39.906724 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c70e2076-17c0-4143-ae10-be0bdda927c1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1308 microversion: 2.1 time: 0.089559 May 12 17:48:39.907303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 412/827] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:39 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:40.924977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:40.925513 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:40.932006 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:40.932466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:40.933336 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:40.933810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:41.158977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:41.167637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-647118d6-0b71-421e-8b11-e3a83abc1e8b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1363 microversion: 2.1 time: 0.246514 May 12 17:48:41.168500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 416/828] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:40 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:41.310268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-dfc0a934-9d87-4f71-8959-b4ffc2a9e6fb req-c8f015c1-d2ed-42c0-8942-71883524a613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9b5fa5-bcf2-4da6-b13c-85aeee61a134", "tag": "57cd4c81-8280-4d5e-b1ca-0c2c662e6d98"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:41.326255 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-dfc0a934-9d87-4f71-8959-b4ffc2a9e6fb req-c8f015c1-d2ed-42c0-8942-71883524a613 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:41.326770 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-dfc0a934-9d87-4f71-8959-b4ffc2a9e6fb req-c8f015c1-d2ed-42c0-8942-71883524a613 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:41.349706 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-dfc0a934-9d87-4f71-8959-b4ffc2a9e6fb req-c8f015c1-d2ed-42c0-8942-71883524a613 service nova] Creating event network-changed:57cd4c81-8280-4d5e-b1ca-0c2c662e6d98 for instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 on hv-cinder-83979 May 12 17:48:41.355124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-dfc0a934-9d87-4f71-8959-b4ffc2a9e6fb req-c8f015c1-d2ed-42c0-8942-71883524a613 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048729 May 12 17:48:41.355852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 413/829] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:42.186034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:42.186644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:42.192948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:42.193399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:42.194164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:42.194607 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:42.322017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:42.329319 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ea9dcc13-0f21-4f4b-afcb-9ed00a9251ff tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1363 microversion: 2.1 time: 0.147208 May 12 17:48:42.329888 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 417/830] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:42 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:43.346738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:43.347450 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:43.353909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:43.354363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:43.355184 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:43.355890 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:43.570488 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:43.578407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3bdc9852-bd9e-482f-882a-e63a9db5604f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1363 microversion: 2.1 time: 0.236579 May 12 17:48:43.579119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 414/831] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:43 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:44.595786 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:44.596395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:44.603596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:44.604046 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:44.604877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:44.605312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:44.732404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:44.739637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-17f304fa-0ee7-4730-98ab-5e87b3bf6a2d tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1363 microversion: 2.1 time: 0.147732 May 12 17:48:44.740199 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 418/832] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:44 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:45.097342 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f8136f5a-5a75-487f-b124-0dec381f1b3d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:45.097908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f8136f5a-5a75-487f-b124-0dec381f1b3d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:45.104372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8136f5a-5a75-487f-b124-0dec381f1b3d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:45.104820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8136f5a-5a75-487f-b124-0dec381f1b3d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:45.105577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8136f5a-5a75-487f-b124-0dec381f1b3d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:45.106007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8136f5a-5a75-487f-b124-0dec381f1b3d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:45.128710 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f8136f5a-5a75-487f-b124-0dec381f1b3d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/ips" status: 200 len: 152 microversion: 2.20 time: 0.035254 May 12 17:48:45.129268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 415/833] 10.222.0.76 () {60 vars in 1288 bytes} [Thu May 12 17:48:45 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:48:45.528140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-6d206586-dcba-438d-897c-30668ffe1976 req-e5c84424-9aa3-436b-8ea9-63eafee96e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9b5fa5-bcf2-4da6-b13c-85aeee61a134", "name": "network-vif-plugged", "status": "completed", "tag": "57cd4c81-8280-4d5e-b1ca-0c2c662e6d98"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:45.536420 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-6d206586-dcba-438d-897c-30668ffe1976 req-e5c84424-9aa3-436b-8ea9-63eafee96e41 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:45.536996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-6d206586-dcba-438d-897c-30668ffe1976 req-e5c84424-9aa3-436b-8ea9-63eafee96e41 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:45.550773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-6d206586-dcba-438d-897c-30668ffe1976 req-e5c84424-9aa3-436b-8ea9-63eafee96e41 service nova] Creating event network-vif-plugged:57cd4c81-8280-4d5e-b1ca-0c2c662e6d98 for instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 on hv-cinder-83979 May 12 17:48:45.556685 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-6d206586-dcba-438d-897c-30668ffe1976 req-e5c84424-9aa3-436b-8ea9-63eafee96e41 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032315 May 12 17:48:45.557279 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 419/834] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:45.757047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:45.757639 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:45.764122 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:45.764582 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:45.765391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:45.765775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:45.901982 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:45.909267 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-363cfc7b-6d95-4bf3-bb9c-f64b5e84c678 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1363 microversion: 2.1 time: 0.156547 May 12 17:48:45.909830 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 416/835] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:45 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:46.927330 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:46.928048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:46.934291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:46.934785 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:46.935563 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:46.936004 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.072092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:47.079238 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0523d5c0-f08e-49ec-aab5-da661bb221b9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1363 microversion: 2.1 time: 0.156612 May 12 17:48:47.079797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 420/836] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:46 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:47.971965 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:47.972488 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:47.979820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.980270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.981039 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.981473 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.065983 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.objects.instance [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lazy-loading 'services' on Instance uuid 0424abb5-9a1e-40d7-9293-6afed05d22a4 {{(pid=123689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:48.094450 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:48.095022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:48.101079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.101536 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.102373 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.102776 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.127638 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lazy-loading 'flavor' on Instance uuid 67972c22-858c-41e6-85f9-27327673af00 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:48.138720 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-75f2c3ca-0417-4c7c-b6d3-53cacc63037f tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments/30d598e0-d2a9-46a8-98f8-b6e22a8a7b8b" status: 202 len: 0 microversion: 2.1 time: 0.171722 May 12 17:48:48.139412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 417/837] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:48:47 2022] DELETE /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments/30d598e0-d2a9-46a8-98f8-b6e22a8a7b8b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:48:48.144362 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:48.145048 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:48.152444 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.152937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.153693 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.154136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.296329 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:48.303820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b9c53f8a-98a8-44a1-885b-5bfb972f4285 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1550 microversion: 2.1 time: 0.163343 May 12 17:48:48.304496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 418/838] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:48 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:48.309714 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d9e69037-0da3-4646-99ca-e87e2e2a1dc1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:48.310614 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d9e69037-0da3-4646-99ca-e87e2e2a1dc1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:48.316243 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d9e69037-0da3-4646-99ca-e87e2e2a1dc1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.316715 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d9e69037-0da3-4646-99ca-e87e2e2a1dc1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.317475 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d9e69037-0da3-4646-99ca-e87e2e2a1dc1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.317908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d9e69037-0da3-4646-99ca-e87e2e2a1dc1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.352165 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d9e69037-0da3-4646-99ca-e87e2e2a1dc1 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 May 12 17:48:48.353470 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 419/839] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:48:48 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:48.360631 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8c2ed164-645e-4021-8602-e8778b5d73db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:48.361133 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8c2ed164-645e-4021-8602-e8778b5d73db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:48.366980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c2ed164-645e-4021-8602-e8778b5d73db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.367438 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c2ed164-645e-4021-8602-e8778b5d73db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.368855 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c2ed164-645e-4021-8602-e8778b5d73db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.369633 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c2ed164-645e-4021-8602-e8778b5d73db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.404403 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c96c90a6-7d1d-42b4-87e9-a02a55a5b9b6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/action" status: 202 len: 0 microversion: 2.20 time: 0.313923 May 12 17:48:48.405238 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 421/840] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 12 17:48:48 2022] POST /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 17:48:48.413800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:48.414500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:48.420929 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.421380 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.422148 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.422583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.449213 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8c2ed164-645e-4021-8602-e8778b5d73db tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094427 May 12 17:48:48.449809 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 420/841] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 12 17:48:48 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:48.553366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:48.561992 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:48.563532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:48.564682 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ae387480-9bd6-476b-963e-bf69980f0876 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.155507 May 12 17:48:48.565246 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 422/842] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:48 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:48:49.371259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-31542eb9-b7f6-4b41-b38c-02deb67d41af tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:49.372174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-31542eb9-b7f6-4b41-b38c-02deb67d41af tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:49.378572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31542eb9-b7f6-4b41-b38c-02deb67d41af tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.379133 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31542eb9-b7f6-4b41-b38c-02deb67d41af tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.379940 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31542eb9-b7f6-4b41-b38c-02deb67d41af tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.380408 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-31542eb9-b7f6-4b41-b38c-02deb67d41af tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.413259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-31542eb9-b7f6-4b41-b38c-02deb67d41af tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048322 May 12 17:48:49.413892 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 421/843] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:48:49 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:48:49.437525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-7c9c5215-750d-4cbc-b4a4-f66d1bd67f1d req-74fedc26-1296-4313-956c-2a1d5e7bf149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9b5fa5-bcf2-4da6-b13c-85aeee61a134", "tag": "57cd4c81-8280-4d5e-b1ca-0c2c662e6d98"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:49.446996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-7c9c5215-750d-4cbc-b4a4-f66d1bd67f1d req-74fedc26-1296-4313-956c-2a1d5e7bf149 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.447633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-7c9c5215-750d-4cbc-b4a4-f66d1bd67f1d req-74fedc26-1296-4313-956c-2a1d5e7bf149 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.459039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-7c9c5215-750d-4cbc-b4a4-f66d1bd67f1d req-74fedc26-1296-4313-956c-2a1d5e7bf149 service nova] Creating event network-changed:57cd4c81-8280-4d5e-b1ca-0c2c662e6d98 for instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 on hv-cinder-83979 May 12 17:48:49.476084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-7c9c5215-750d-4cbc-b4a4-f66d1bd67f1d req-74fedc26-1296-4313-956c-2a1d5e7bf149 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041415 May 12 17:48:49.477835 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 423/844] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:49.489693 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:49.490119 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:49.497092 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.497550 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.498327 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.498796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.525651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:49.583729 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:49.584434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:49.592815 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.593275 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.594077 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.594535 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.622536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-01c1479b-1c6e-4176-b04e-efdb086a2d18 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 204 len: 0 microversion: 2.1 time: 0.136404 May 12 17:48:49.623176 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 422/845] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:48:49 2022] DELETE /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:48:49.633006 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:49.634388 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:49.643969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.644560 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.645383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.646019 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.753728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:49.762838 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:49.764341 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:49.765515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3d47670d-5ab4-44d5-9a01-6603ac8f2ad6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.186957 May 12 17:48:49.777022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 424/846] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:49 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:48:49.803052 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:49.812237 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f2b998eb-1465-44a9-9711-27f321f885a3 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1688 microversion: 2.1 time: 0.183797 May 12 17:48:49.812813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 423/847] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:49 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:50.785277 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:50.785897 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:50.793036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:50.793416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:50.794175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:50.794603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:50.830501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:50.831157 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:50.837933 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:50.838377 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:50.839191 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:50.839630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:50.927097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:50.935831 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:50.937355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:50.938510 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5cec905f-03fa-4eb4-90bb-af9c9b617ade tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.157126 May 12 17:48:50.939104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 425/848] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:50 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:50.972173 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:50.979600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-738f3eff-9c41-4c84-a548-77d30ae19578 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1688 microversion: 2.1 time: 0.153225 May 12 17:48:50.980169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 424/849] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:50 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:51.958005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:51.958610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:51.965645 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:51.966089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:51.966884 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:51.967322 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:51.996413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:51.997026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:52.003408 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:52.003863 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:52.004670 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:52.005114 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:52.101581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:52.113154 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:52.114687 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:52.115839 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-59e9743a-02a7-428f-8a05-6ba6e18fc015 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.162422 May 12 17:48:52.116430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 426/850] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:51 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:52.137099 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:52.144410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ccf13d2d-8be8-4484-b52b-e20bb4c6b3b0 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1688 microversion: 2.1 time: 0.152130 May 12 17:48:52.144978 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 425/851] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:51 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:53.135460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:53.136039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:53.142286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:53.142762 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:53.143523 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:53.143958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:53.161767 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:53.162379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:53.168695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:53.169154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:53.169925 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:53.170365 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:53.275857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:53.283663 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:53.285980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:53.287465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-375a3a5e-5544-4046-a8e6-1ba40f843354 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.156900 May 12 17:48:53.288458 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 427/852] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:53 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:53.304491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:53.311895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2c362376-e772-4203-ada4-de11cf3aa528 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1688 microversion: 2.1 time: 0.153956 May 12 17:48:53.312461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 426/853] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:53 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:54.305749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:54.306353 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:54.312676 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:54.313128 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:54.313892 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:54.314333 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:54.330257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:54.330987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:54.336828 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:54.337284 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:54.338069 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:54.338513 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:54.477593 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:54.485532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:54.487178 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:54.488344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f1010119-b817-456e-84e9-1db8515098ca tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.186988 May 12 17:48:54.489145 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 428/854] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:54 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:54.798046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:54.806406 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-863e9743-ef3c-421b-8254-c3edab64ff3c tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1688 microversion: 2.1 time: 0.481165 May 12 17:48:54.807370 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 427/855] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:54 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1688 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:55.327027 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-134dbaea-c703-4b92-982b-92e68242ceb2 req-f1971e3a-ff0d-4899-8977-8940322cbae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0424abb5-9a1e-40d7-9293-6afed05d22a4", "name": "network-vif-deleted", "tag": "e7bcf6a7-e3d8-42ac-93af-72139b9509fa"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:55.336954 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-134dbaea-c703-4b92-982b-92e68242ceb2 req-f1971e3a-ff0d-4899-8977-8940322cbae9 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.337404 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-134dbaea-c703-4b92-982b-92e68242ceb2 req-f1971e3a-ff0d-4899-8977-8940322cbae9 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.349084 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-134dbaea-c703-4b92-982b-92e68242ceb2 req-f1971e3a-ff0d-4899-8977-8940322cbae9 service nova] Creating event network-vif-deleted:e7bcf6a7-e3d8-42ac-93af-72139b9509fa for instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 on hv-cinder-83979 May 12 17:48:55.358415 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-134dbaea-c703-4b92-982b-92e68242ceb2 req-f1971e3a-ff0d-4899-8977-8940322cbae9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035883 May 12 17:48:55.359415 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 429/856] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:55.506567 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:55.507564 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:55.517509 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.517963 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.518784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.519218 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.815158 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:55.825233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:55.826030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:55.826598 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:55.828221 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:55.829397 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c0c7eeaf-6419-46c0-ada3-5495a7fc2184 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.326863 May 12 17:48:55.830139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 428/857] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:55 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:55.843679 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.844363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.845162 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.845605 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.880552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.881321 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.881934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lazy-loading 'fault' on Instance uuid 0424abb5-9a1e-40d7-9293-6afed05d22a4 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:55.930233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:55.937337 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-63bce14b-4e31-43c9-8c54-529a151f7a61 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 200 len: 1335 microversion: 2.1 time: 0.117148 May 12 17:48:55.942723 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 430/858] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:55 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:56.847910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:56.848508 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:56.855347 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.855796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.856555 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.856988 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.955087 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:56.955716 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: 0424abb5-9a1e-40d7-9293-6afed05d22a4] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:56.962001 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.963038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.963809 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.964261 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.978560 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] HTTP exception thrown: Instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 could not be found. May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Request method failure captured: May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 HTTP/1.1 May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUdSt7CuCtUuj1igLX403WPelXYYDhXrwsO_WFe9JIdu0Ze95DTlZWoLml0rwnxVW9-Oh59tmCNB6nEzSTue2tK2cUC1lGABUpQMzFwg4Bc_7pYb8bQT_-xcCJCGM1AkYtQj250Vp1sCL8Mmg8LNaK-Yn-UhT8sHeKHWRlQ2Kau6WsA May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:48:56.980237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bcee5099fd2b4df2adaa069af3a45733", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ee532b08897148dd9ff0482a00f537f7 May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 could not be found. May 12 17:48:56.981856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '0424abb5-9a1e-40d7-9293-6afed05d22a4'} May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 could not be found. May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:56.985779 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 could not be found. May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 could not be found. May 12 17:48:56.987396 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:48:56.988912 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Returning 404 to user: Instance 0424abb5-9a1e-40d7-9293-6afed05d22a4 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:56.988912 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-cfdce8e7-be29-468c-aee8-4115431ef72d tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4" status: 404 len: 111 microversion: 2.1 time: 0.030639 May 12 17:48:56.988912 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 431/859] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:56 2022] GET /compute/v2.1/servers/0424abb5-9a1e-40d7-9293-6afed05d22a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:48:56.989173 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:56.991844 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3a83466e-7afe-4292-8c4e-2e3740512c21 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '.version_select at 0x7f24bc1e5790>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:56.994292 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:56.995825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:56.997015 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-03d76b62-f774-4c6c-bd06-5d7f5757956b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.152951 May 12 17:48:56.997563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 429/860] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:56 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:57.011121 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3a83466e-7afe-4292-8c4e-2e3740512c21 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105507590" status: 202 len: 0 microversion: 2.1 time: 0.024144 May 12 17:48:57.011684 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 432/861] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 12 17:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105507590 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:48:58.016094 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:58.016701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:58.023298 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:58.023756 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:58.024530 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:58.024969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:58.152264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:58.159919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:58.161916 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:58.163082 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-196fd873-ffbc-4689-97fd-c248226e393d tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.150945 May 12 17:48:58.163625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 430/862] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:58 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:59.183471 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:59.184075 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:59.190545 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.191020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.191775 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.192205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.321395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:59.329139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:59.330637 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:59.331802 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-73f4925b-a028-425a-8732-ddfd361a30c9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.153811 May 12 17:48:59.332362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 433/863] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:48:59 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:59.846853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:59.847357 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:59.854106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.854555 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.855353 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.855789 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.880090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:59.955052 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-19ceb19c-4a49-40db-b120-3fe75527eb11 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 204 len: 0 microversion: 2.1 time: 0.111632 May 12 17:48:59.955730 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 431/864] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:48:59 2022] DELETE /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:48:59.964487 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:59.965129 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:59.971035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.971486 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.972260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.972697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:00.098334 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:00.106337 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-19a2cbcb-2163-4781-9de3-69948cddb131 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1505 microversion: 2.1 time: 0.146258 May 12 17:49:00.106918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 434/865] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:48:59 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:00.350962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:00.351629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:00.358913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:00.359362 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:00.360123 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:00.360557 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:00.490236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:00.498171 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:00.499692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:00.500880 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3c2805cf-8e15-48ae-a27b-102b573defb2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.154240 May 12 17:49:00.501430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 432/866] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:00 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:01.123468 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:01.124101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:01.130384 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.130879 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.131650 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.132092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.263088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:01.270334 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a2270381-cfde-4889-9f98-4376fe843409 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1505 microversion: 2.1 time: 0.150711 May 12 17:49:01.270946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 435/867] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:01 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:01.519642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:01.520177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:01.527748 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.528201 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.528970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.529406 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.657859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:01.665709 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:01.667236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:01.668387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d99fcc94-10ea-4dd2-8246-cc8011aa63a1 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.152726 May 12 17:49:01.668945 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 433/868] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:01 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:02.291972 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:02.293640 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:02.304343 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:02.304804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:02.305951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:02.306431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:02.387758 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-060c32de-4ec0-4747-a795-9cb92c884943 req-1aabe9e4-8133-4e6b-b77a-6a50c5d1dc54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c977bb-536a-402e-9bb1-f6f30944d7d1", "name": "network-vif-deleted", "tag": "ddbcad82-027a-4849-b06e-806434038d9b"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:02.416149 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:02.422285 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-060c32de-4ec0-4747-a795-9cb92c884943 req-1aabe9e4-8133-4e6b-b77a-6a50c5d1dc54 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:02.423193 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-060c32de-4ec0-4747-a795-9cb92c884943 req-1aabe9e4-8133-4e6b-b77a-6a50c5d1dc54 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:02.424685 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d9d3edfd-62f2-4e9b-9b1e-0afc950d6d73 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 200 len: 1463 microversion: 2.1 time: 0.139537 May 12 17:49:02.426717 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 436/869] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:02 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 1463 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:02.441948 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-060c32de-4ec0-4747-a795-9cb92c884943 req-1aabe9e4-8133-4e6b-b77a-6a50c5d1dc54 service nova] Creating event network-vif-deleted:ddbcad82-027a-4849-b06e-806434038d9b for instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 on hv-cinder-83979 May 12 17:49:02.446738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-060c32de-4ec0-4747-a795-9cb92c884943 req-1aabe9e4-8133-4e6b-b77a-6a50c5d1dc54 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063675 May 12 17:49:02.447657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 434/870] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:49:02.687002 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:02.687604 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:02.693621 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:02.694068 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:02.694874 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:02.695308 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:02.828825 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:02.837609 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:02.839128 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:02.840262 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8ce6bde9-6ac4-4118-8998-4ef999e1fb5e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.157136 May 12 17:49:02.840819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 437/871] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:02 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:03.443288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:03.443994 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: b8c977bb-536a-402e-9bb1-f6f30944d7d1] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:03.450259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.450739 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.451514 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.451956 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.464827 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] HTTP exception thrown: Instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 could not be found. May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Request method failure captured: May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 HTTP/1.1 May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUdSt7CuCtUuj1igLX403WPelXYYDhXrwsO_WFe9JIdu0Ze95DTlZWoLml0rwnxVW9-Oh59tmCNB6nEzSTue2tK2cUC1lGABUpQMzFwg4Bc_7pYb8bQT_-xcCJCGM1AkYtQj250Vp1sCL8Mmg8LNaK-Yn-UhT8sHeKHWRlQ2Kau6WsA May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:49:03.466430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bcee5099fd2b4df2adaa069af3a45733", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ee532b08897148dd9ff0482a00f537f7 May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 could not be found. May 12 17:49:03.467981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': 'b8c977bb-536a-402e-9bb1-f6f30944d7d1'} May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 could not be found. May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:03.469153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 could not be found. May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 could not be found. May 12 17:49:03.471675 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:03.472952 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Returning 404 to user: Instance b8c977bb-536a-402e-9bb1-f6f30944d7d1 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:03.472952 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cd6495e6-7b27-4aaa-8843-f35c69527c77 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1" status: 404 len: 111 microversion: 2.1 time: 0.029231 May 12 17:49:03.472952 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 435/872] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:03 2022] GET /compute/v2.1/servers/b8c977bb-536a-402e-9bb1-f6f30944d7d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:03.476062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:03.476559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:03.483768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.484224 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.485425 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.485871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.512068 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:49:03.585479 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7023d260-d51d-44ba-8160-af9fbeefb505 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 204 len: 0 microversion: 2.1 time: 0.112836 May 12 17:49:03.586063 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 438/873] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:49:03 2022] DELETE /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 17:49:03.595901 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:03.596514 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:03.603493 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.603942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.604714 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.605146 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.732873 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:03.740120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-baa1f7cf-17a5-4cf0-b6e5-f9cc3e15e521 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.149228 May 12 17:49:03.740673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 436/874] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:03 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:03.859171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:03.859854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:03.865692 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.866143 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.866925 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.867852 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.999445 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:04.007024 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:04.009259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:04.010391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9763c9b4-b139-4c33-9e3d-3df9b9a05a57 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.155481 May 12 17:49:04.010982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 439/875] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:03 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:04.757179 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:04.757808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:04.764326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:04.764776 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:04.765537 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:04.765976 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:04.894700 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:04.902922 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e91480c5-d997-4b4e-9a8e-ec0f4f5d1f01 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.149619 May 12 17:49:04.903485 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 437/876] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:04 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:05.029263 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:05.029805 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:05.036053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:05.036505 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:05.037270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:05.037705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:05.163028 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:05.170956 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:05.172466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:05.173618 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8cd847d0-0a51-409a-9bcc-cd525c513d4a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.148339 May 12 17:49:05.174175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 440/877] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:05 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:05.920136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:05.920740 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:05.927001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:05.927448 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:05.928202 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:05.928636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:06.054852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:06.063090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ebd9b3ae-97a2-4290-9d6b-0c471fba4038 tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1520 microversion: 2.1 time: 0.146767 May 12 17:49:06.063648 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 438/878] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:05 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:06.192165 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:06.192698 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:06.199703 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:06.200158 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:06.200927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:06.201367 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:06.328679 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:06.337112 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:06.338652 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:06.339869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a7f47c46-72f7-4f76-b230-74a1aa1f3e82 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.151787 May 12 17:49:06.340425 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 441/879] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:06 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:07.033026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-05ac1fb5-30d3-4ff6-bade-a102d15114a9 req-f9f3d89f-abb7-4023-90c8-a03b94049bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9fe1954-0d79-4a7b-a18f-463a1e44b42a", "name": "network-vif-deleted", "tag": "63804ffd-8d9a-4673-82b0-a8a919c81e0c"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:07.045705 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-05ac1fb5-30d3-4ff6-bade-a102d15114a9 req-f9f3d89f-abb7-4023-90c8-a03b94049bf1 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:07.046215 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-05ac1fb5-30d3-4ff6-bade-a102d15114a9 req-f9f3d89f-abb7-4023-90c8-a03b94049bf1 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:07.060125 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-05ac1fb5-30d3-4ff6-bade-a102d15114a9 req-f9f3d89f-abb7-4023-90c8-a03b94049bf1 service nova] Creating event network-vif-deleted:63804ffd-8d9a-4673-82b0-a8a919c81e0c for instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a on hv-cinder-83979 May 12 17:49:07.066183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-05ac1fb5-30d3-4ff6-bade-a102d15114a9 req-f9f3d89f-abb7-4023-90c8-a03b94049bf1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041357 May 12 17:49:07.067291 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 439/880] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:07.080723 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:07.081843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:07.089291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:07.089766 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:07.090557 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:07.091053 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:07.162801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee532b08897148dd9ff0482a00f537f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcee5099fd2b4df2adaa069af3a45733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:07.171533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-47d87e2a-18fe-41b1-8865-845a9ed14b2e tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 200 len: 1307 microversion: 2.1 time: 0.094637 May 12 17:49:07.172119 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 442/881] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:07 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:07.357898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:07.358912 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:07.365299 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:07.365784 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:07.366551 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:07.367018 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:07.499747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:07.507452 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:07.509142 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:07.510303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-87d19b33-7429-46d7-b407-65028f079c42 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.156701 May 12 17:49:07.510895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 440/882] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:07 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:49:08.190049 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:08.190641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] [instance: f9fe1954-0d79-4a7b-a18f-463a1e44b42a] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:08.197366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:08.197815 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:08.198582 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:08.199040 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:08.212870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] HTTP exception thrown: Instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a could not be found. May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Request method failure captured: May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a HTTP/1.1 May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUdSt7CuCtUuj1igLX403WPelXYYDhXrwsO_WFe9JIdu0Ze95DTlZWoLml0rwnxVW9-Oh59tmCNB6nEzSTue2tK2cUC1lGABUpQMzFwg4Bc_7pYb8bQT_-xcCJCGM1AkYtQj250Vp1sCL8Mmg8LNaK-Yn-UhT8sHeKHWRlQ2Kau6WsA May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:49:08.214538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bcee5099fd2b4df2adaa069af3a45733", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bcee5099fd2b4df2adaa069af3a45733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: bcee5099fd2b4df2adaa069af3a45733 May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1756010654 May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ee532b08897148dd9ff0482a00f537f7 May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1756010654-project May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a could not be found. May 12 17:49:08.215984 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'f9fe1954-0d79-4a7b-a18f-463a1e44b42a'} May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a could not be found. May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:08.216740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a could not be found. May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a could not be found. May 12 17:49:08.217918 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:08.219009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] Returning 404 to user: Instance f9fe1954-0d79-4a7b-a18f-463a1e44b42a could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:08.219009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-82cf13b1-fdc4-4692-84fb-e6aa2be406fe tempest-ServerRescueNegativeTestJSON-1756010654 tempest-ServerRescueNegativeTestJSON-1756010654-project] 10.222.0.76 "GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a" status: 404 len: 111 microversion: 2.1 time: 0.029903 May 12 17:49:08.219009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 443/883] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:08 2022] GET /compute/v2.1/servers/f9fe1954-0d79-4a7b-a18f-463a1e44b42a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:49:08.532129 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:08.532715 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:08.538999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:08.540085 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:08.540882 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:08.541319 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:08.669635 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:08.677411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:08.678943 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:08.680290 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-955d2713-f904-4a8b-ab90-53f4eb6798cf tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.152123 May 12 17:49:08.680846 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 441/884] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:08 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:09.697490 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:09.698096 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:09.704174 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:09.704627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:09.705398 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:09.705833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:09.879243 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:09.887920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:09.889411 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:09.890552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2e4ed9cf-69ab-416d-99e2-84152a828750 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1745 microversion: 2.20 time: 0.197010 May 12 17:49:09.891125 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 444/885] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:09 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:10.910827 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:10.911440 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:10.918549 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:10.919040 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:10.919825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:10.920264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:11.150615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:11.165589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:11.167422 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:11.168817 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-720b4501-caa4-40e9-9c6c-fb39dafd05e7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1745 microversion: 2.20 time: 0.263006 May 12 17:49:11.169474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 442/886] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:10 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1745 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:12.189103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:12.189706 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:12.196516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:12.196892 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:12.197646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:12.198237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:12.345106 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:12.354071 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:12.355622 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:12.356774 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8c2240d9-2f4c-4119-b5dd-64e86c204b4f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.171496 May 12 17:49:12.357324 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 445/887] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:12 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:13.374567 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:13.376088 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:13.385478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:13.386316 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:13.387375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:13.388029 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:13.540942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:13.550977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-225283e7-e9ed-4b62-9a93-85b5191fc7a5 req-a7494f69-4279-4a16-8568-b2a5dfd7076d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67972c22-858c-41e6-85f9-27327673af00", "name": "network-vif-plugged", "status": "completed", "tag": "143d4171-1885-4746-8f1e-a6334c3f41fe"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:13.567862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:13.571790 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-225283e7-e9ed-4b62-9a93-85b5191fc7a5 req-a7494f69-4279-4a16-8568-b2a5dfd7076d service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:13.578547 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:13.579060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-225283e7-e9ed-4b62-9a93-85b5191fc7a5 req-a7494f69-4279-4a16-8568-b2a5dfd7076d service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:13.583153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-64e903e6-7378-486d-9241-ef3ea3ec38cd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.212311 May 12 17:49:13.585797 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 443/888] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:13 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:13.594814 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-225283e7-e9ed-4b62-9a93-85b5191fc7a5 req-a7494f69-4279-4a16-8568-b2a5dfd7076d service nova] Creating event network-vif-plugged:143d4171-1885-4746-8f1e-a6334c3f41fe for instance 67972c22-858c-41e6-85f9-27327673af00 on hv-cinder-83979 May 12 17:49:13.604407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-225283e7-e9ed-4b62-9a93-85b5191fc7a5 req-a7494f69-4279-4a16-8568-b2a5dfd7076d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061280 May 12 17:49:13.605657 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 446/889] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:14.097989 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ef9e81c6-e74d-4be3-9a9a-da97bbe4fe28 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc14bd30>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:14.150499 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ef9e81c6-e74d-4be3-9a9a-da97bbe4fe28 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/6d22c5ab-ce75-4f32-aa0a-022c0a1b2d95" status: 200 len: 350 microversion: 2.1 time: 0.056229 May 12 17:49:14.151109 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 444/890] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:49:14 2022] GET /compute/v2.1/os-volumes/6d22c5ab-ce75-4f32-aa0a-022c0a1b2d95 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:14.604761 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:14.605494 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:14.612972 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.613550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.614784 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.615414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.762335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:14.771901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:14.774037 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:14.775808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7f56b8b8-cbc6-47d5-9f38-68b6922a46b9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.176709 May 12 17:49:14.776555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 447/891] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:14 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:15.537063 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ead2e2f7-7db5-4725-a9f4-f39fb924fb70 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc187c10>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:15.604295 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ead2e2f7-7db5-4725-a9f4-f39fb924fb70 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/6260a82c-fa27-48d3-bf3e-3bce83ef2471" status: 200 len: 350 microversion: 2.1 time: 0.070755 May 12 17:49:15.605185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 445/892] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:49:15 2022] GET /compute/v2.1/os-volumes/6260a82c-fa27-48d3-bf3e-3bce83ef2471 => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:15.797423 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:15.798624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:15.807081 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.807834 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.808866 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.809502 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.981595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:15.993740 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:15.995299 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:15.996803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-cc3739f8-0d1d-4aa8-9c4d-28383c6f5e2f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.203437 May 12 17:49:15.997775 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 448/893] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:15 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:16.981994 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d2eb9170-d96a-4f30-8d17-a2fb9a6c162c tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc225dc0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.016174 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.017362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:17.025293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:17.025751 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:17.026728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:17.027339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:17.037460 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d2eb9170-d96a-4f30-8d17-a2fb9a6c162c tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/6b48460b-b438-4ac8-9fb1-d86804de60e8" status: 200 len: 351 microversion: 2.1 time: 0.060919 May 12 17:49:17.038049 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 446/894] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:49:16 2022] GET /compute/v2.1/os-volumes/6b48460b-b438-4ac8-9fb1-d86804de60e8 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:17.049688 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ddd8f012-a351-4416-bd5d-8e0cf5908958 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc2d8ca0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.203017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ddd8f012-a351-4416-bd5d-8e0cf5908958 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.156906 May 12 17:49:17.208981 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 447/895] 10.222.0.76 () {58 vars in 1133 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:17.222497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:17.223428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4b879b2b-70c9-42a9-8447-be12f9d87d74 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc14bee0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.234153 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:17.235633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:17.238324 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e38c0937-1bb2-44ce-8636-ee5a7777318f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.225832 May 12 17:49:17.239426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 449/896] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:17.325909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4b879b2b-70c9-42a9-8447-be12f9d87d74 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.106138 May 12 17:49:17.326795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 448/897] 10.222.0.76 () {58 vars in 1148 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:17.342170 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fb2cd81a-c81d-4923-afbe-7baad05a7562 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc10df70>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.436628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-fb2cd81a-c81d-4923-afbe-7baad05a7562 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.100574 May 12 17:49:17.437481 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 450/898] 10.222.0.76 () {58 vars in 1133 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:17.448967 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cf627009-d237-42b3-8aca-539fe1620eca tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc16f8b0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.549984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cf627009-d237-42b3-8aca-539fe1620eca tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104930 May 12 17:49:17.550554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 449/899] 10.222.0.76 () {58 vars in 1166 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:17.563891 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3fff2510-d228-4ac5-b17f-b0cb1061d737 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc1a9c10>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.654915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3fff2510-d228-4ac5-b17f-b0cb1061d737 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094703 May 12 17:49:17.655514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 451/900] 10.222.0.76 () {58 vars in 1169 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:17.668354 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a8dfbd26-de61-49e6-b42d-79ebc298eb2c tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc16f4c0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.755101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a8dfbd26-de61-49e6-b42d-79ebc298eb2c tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090626 May 12 17:49:17.755672 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 450/901] 10.222.0.76 () {58 vars in 1154 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:17.768292 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fedc3a61-53eb-478f-bbe9-ae1ab580decc tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc11f4c0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.870761 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-fedc3a61-53eb-478f-bbe9-ae1ab580decc tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.106125 May 12 17:49:17.874710 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 452/902] 10.222.0.76 () {58 vars in 1187 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:49:17.883624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d9984d93-f8f7-4841-b626-ff3d21b9d186 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] Calling method '.version_select at 0x7f24bc14bee0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.977490 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d9984d93-f8f7-4841-b626-ff3d21b9d186 tempest-VolumesTestJSON-1685209375 tempest-VolumesTestJSON-1685209375-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098413 May 12 17:49:17.989400 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 451/903] 10.222.0.76 () {58 vars in 1154 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:18.259705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:18.260305 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:18.266393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:18.267214 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:18.268007 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:18.268443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:18.443030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:18.455871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:18.457738 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:18.459139 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-235d2585-addd-47a5-bff5-4d93079a7311 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.205024 May 12 17:49:18.460205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 453/904] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:18 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:19.478539 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:19.479231 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:19.486913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:19.487449 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:19.488317 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:19.488835 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:19.649654 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:19.662168 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:19.663936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:19.665174 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-11e7e8de-542b-410d-a3b7-50d1592c417a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.191388 May 12 17:49:19.666109 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 452/905] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:19 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:20.684666 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:20.685290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:20.693253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:20.693990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:20.695138 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:20.697286 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:20.835098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:20.844021 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:20.845626 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:20.847024 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5e48da83-ded2-4f01-974a-1c1744118161 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.167133 May 12 17:49:20.848191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 454/906] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:20 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:20.967197 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6279cc89-e02a-4bb9-b29e-ec10721251a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:20.967734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6279cc89-e02a-4bb9-b29e-ec10721251a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:20.973953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6279cc89-e02a-4bb9-b29e-ec10721251a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:20.974478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6279cc89-e02a-4bb9-b29e-ec10721251a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:20.975297 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6279cc89-e02a-4bb9-b29e-ec10721251a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:20.975717 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6279cc89-e02a-4bb9-b29e-ec10721251a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:21.001772 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6279cc89-e02a-4bb9-b29e-ec10721251a5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/ips" status: 200 len: 149 microversion: 2.1 time: 0.037839 May 12 17:49:21.003197 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 453/907] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:49:20 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:21.866568 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:21.867473 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:21.873652 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:21.874167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:21.874976 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:21.875407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:22.074759 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:22.082869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:22.084504 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:22.085796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-cc150107-86d1-4a6d-b9db-97488e02a2f6 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1740 microversion: 2.20 time: 0.223338 May 12 17:49:22.086438 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 455/908] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:21 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:22.349647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a89a0da5-fde1-4d15-b88d-0148ca30506e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a6bbf12-e8dc-47c5-af6d-a48aaa6ef03d"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:22.351296 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a89a0da5-fde1-4d15-b88d-0148ca30506e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:22.357555 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a89a0da5-fde1-4d15-b88d-0148ca30506e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:22.358015 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a89a0da5-fde1-4d15-b88d-0148ca30506e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:22.358842 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a89a0da5-fde1-4d15-b88d-0148ca30506e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:22.359267 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a89a0da5-fde1-4d15-b88d-0148ca30506e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:22.620386 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a89a0da5-fde1-4d15-b88d-0148ca30506e tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "POST /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274420 May 12 17:49:22.622762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 454/909] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:49:22 2022] POST /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:23.104515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:23.105131 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:23.111622 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:23.112079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:23.112876 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:23.113399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:23.247979 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:23.255747 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:23.257250 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:23.258443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4709c1fb-30e5-4897-a6d1-b6a022defefe tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1722 microversion: 2.20 time: 0.158384 May 12 17:49:23.259029 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 456/910] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:23 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:24.278164 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:24.278907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:24.285732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:24.286188 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:24.287006 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:24.287440 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:24.416486 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:24.424442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:24.425924 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:24.427081 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6a870c23-ac9f-42a2-98f3-4be0b3735aac tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1722 microversion: 2.20 time: 0.153177 May 12 17:49:24.427624 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 455/911] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:24 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:24.834152 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:24.834711 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:24.841724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:24.842174 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:24.842967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:24.843406 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:24.866017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lazy-loading 'flavor' on Instance uuid 94af4804-8a27-4f9b-b471-7fa1a1dabedf {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:49:24.937932 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-954fc6fa-56fa-49d6-8507-3d09f0116a80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "POST /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf/action" status: 202 len: 0 microversion: 2.1 time: 0.107194 May 12 17:49:24.938648 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 457/912] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:49:24 2022] POST /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:49:24.948472 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:24.949132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:24.956361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:24.956857 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:24.957770 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:24.958290 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.110700 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.120152 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-748964ea-cac6-43a0-ac4c-7ca4e65ed528 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.176747 May 12 17:49:25.120736 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 456/913] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:24 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:25.447248 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:25.447948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:25.454073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.454571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.455472 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.455919 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.595646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.604234 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.605770 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.606951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-109cde14-2c0a-4608-bfd9-b60fe82749e5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1725 microversion: 2.20 time: 0.164621 May 12 17:49:25.607508 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 458/914] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:25 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:25.624481 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e2e0bf5a-ab9c-43d9-9731-078df2f10620 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a96c819-0e5b-4e2e-8343-32481d8e9c73"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:25.625761 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e2e0bf5a-ab9c-43d9-9731-078df2f10620 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:25.632166 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e2e0bf5a-ab9c-43d9-9731-078df2f10620 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.632644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e2e0bf5a-ab9c-43d9-9731-078df2f10620 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.633528 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e2e0bf5a-ab9c-43d9-9731-078df2f10620 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.633968 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e2e0bf5a-ab9c-43d9-9731-078df2f10620 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.896496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e2e0bf5a-ab9c-43d9-9731-078df2f10620 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275965 May 12 17:49:25.897097 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 457/915] 10.222.0.76 () {62 vars in 1363 bytes} [Thu May 12 17:49:25 2022] POST /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:49:26.006509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-18e8d0ae-ed19-46a5-bcfd-46910d5be2d0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:26.007103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-18e8d0ae-ed19-46a5-bcfd-46910d5be2d0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:26.013296 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-18e8d0ae-ed19-46a5-bcfd-46910d5be2d0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.013743 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-18e8d0ae-ed19-46a5-bcfd-46910d5be2d0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.014505 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-18e8d0ae-ed19-46a5-bcfd-46910d5be2d0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.014963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-18e8d0ae-ed19-46a5-bcfd-46910d5be2d0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.138432 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:26.139182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:26.145030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.145554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.146427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.146966 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.273703 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-18e8d0ae-ed19-46a5-bcfd-46910d5be2d0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-volume_attachments/1a96c819-0e5b-4e2e-8343-32481d8e9c73" status: 202 len: 0 microversion: 2.20 time: 0.270556 May 12 17:49:26.277627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 459/916] 10.222.0.76 () {60 vars in 1456 bytes} [Thu May 12 17:49:26 2022] DELETE /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-volume_attachments/1a96c819-0e5b-4e2e-8343-32481d8e9c73 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:49:26.297860 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.307225 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1cbb325e-c8e8-4b11-918a-b7f12b2437bb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.172884 May 12 17:49:26.310744 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 458/917] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:26 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:26.334062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-de7ad764-a3eb-46e1-859e-e7f624507ca5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:26.334623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-de7ad764-a3eb-46e1-859e-e7f624507ca5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:26.341608 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de7ad764-a3eb-46e1-859e-e7f624507ca5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.342057 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de7ad764-a3eb-46e1-859e-e7f624507ca5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.342864 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de7ad764-a3eb-46e1-859e-e7f624507ca5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.343300 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de7ad764-a3eb-46e1-859e-e7f624507ca5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.439468 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-de7ad764-a3eb-46e1-859e-e7f624507ca5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "POST /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/action" status: 202 len: 0 microversion: 2.20 time: 0.109260 May 12 17:49:26.443167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 460/918] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 12 17:49:26 2022] POST /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:49:26.450276 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:26.450949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:26.458638 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.458638 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.459490 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.459834 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.607014 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.615153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.616758 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.618140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0946337b-490a-4ecd-a06b-1bc6eeb08a29 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1673 microversion: 2.20 time: 0.173654 May 12 17:49:26.626851 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 459/919] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:26 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:27.327528 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:27.328161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:27.334092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.334541 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:27.335339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.335797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:27.470319 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:27.478441 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-dd701479-a4b7-4afc-9783-facce904fd80 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.156418 May 12 17:49:27.479368 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 461/920] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:27 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:27.638405 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:27.639045 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:27.645318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.645766 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:27.646530 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.646994 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:27.782421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:27.790207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:27.791991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:27.793393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0dc8f1fc-be63-44cd-8408-78ba9f2b2cef tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1673 microversion: 2.20 time: 0.159173 May 12 17:49:27.794091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 460/921] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:27 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:28.487850 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-bbb8b823-39a2-43ac-b5a2-ea098d975b89 req-2d6618b3-c15c-4e79-b073-da6d1f5e9ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67972c22-858c-41e6-85f9-27327673af00", "name": "network-vif-unplugged", "status": "completed", "tag": "143d4171-1885-4746-8f1e-a6334c3f41fe"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:28.496673 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:28.497301 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:28.498280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bbb8b823-39a2-43ac-b5a2-ea098d975b89 req-2d6618b3-c15c-4e79-b073-da6d1f5e9ca6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:28.498731 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-bbb8b823-39a2-43ac-b5a2-ea098d975b89 req-2d6618b3-c15c-4e79-b073-da6d1f5e9ca6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:28.503642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:28.504100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:28.504886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:28.505326 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:28.516803 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.compute.server_external_events [req-bbb8b823-39a2-43ac-b5a2-ea098d975b89 req-2d6618b3-c15c-4e79-b073-da6d1f5e9ca6 service nova] Unable to find a host for instance 67972c22-858c-41e6-85f9-27327673af00. Dropping event network-vif-unplugged {{(pid=123688) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 17:49:28.517804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-bbb8b823-39a2-43ac-b5a2-ea098d975b89 req-2d6618b3-c15c-4e79-b073-da6d1f5e9ca6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033834 May 12 17:49:28.518836 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 462/922] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 12 17:49:28.643535 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.654638 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-793d429f-76e7-49ce-a7db-0aaf548dba49 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.162837 May 12 17:49:28.655262 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 461/923] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:28 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:28.812067 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:28.812596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:28.818470 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:28.818951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:28.819707 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:28.820294 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:28.948799 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.956539 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.958016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.959176 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f0abc7c4-68fa-454b-8aa7-4d968e231280 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1675 microversion: 2.20 time: 0.151119 May 12 17:49:28.959721 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 463/924] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:28 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:29.671474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:29.672209 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:29.678389 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.678909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:29.679836 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.680362 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:29.816308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:29.825050 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-aa674c01-4468-468a-8575-768b36348f4e tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.157335 May 12 17:49:29.825627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 462/925] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:29 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:29.977867 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:29.978474 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:29.984687 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.985131 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:29.985892 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.986316 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.554985 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:30.562811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:30.564577 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:30.565739 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-854b212f-a77e-4d05-ad4a-7ca4ed0cf97b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.592238 May 12 17:49:30.566280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 464/926] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:29 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:30.842464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:30.843116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:30.849428 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:30.849884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.850657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:30.851127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.994395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:31.002569 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2c3040fe-9239-4d16-85f4-130fd29bfdf0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.163918 May 12 17:49:31.012905 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 463/927] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:30 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:31.294956 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:31.295497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:31.301583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.302038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.302846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.303347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.394531 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lazy-loading 'services' on Instance uuid d1dbd33a-296d-424f-931d-cbf3fb15edca {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:49:31.476960 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0ffd4e03-b8eb-4c10-ad22-e203025c0c33 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments/0a6bbf12-e8dc-47c5-af6d-a48aaa6ef03d" status: 202 len: 0 microversion: 2.1 time: 0.185600 May 12 17:49:31.477829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 465/928] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:49:31 2022] DELETE /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments/0a6bbf12-e8dc-47c5-af6d-a48aaa6ef03d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:49:31.486522 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8ddd722b-d85e-4417-9b32-59e741de326a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:31.487523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8ddd722b-d85e-4417-9b32-59e741de326a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:31.495161 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8ddd722b-d85e-4417-9b32-59e741de326a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.495864 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8ddd722b-d85e-4417-9b32-59e741de326a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.496667 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8ddd722b-d85e-4417-9b32-59e741de326a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.497959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8ddd722b-d85e-4417-9b32-59e741de326a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.531758 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8ddd722b-d85e-4417-9b32-59e741de326a tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049325 May 12 17:49:31.534732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 464/929] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:31 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:31.590520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:31.591540 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:31.600821 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.602103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.603019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.603681 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.747263 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:31.759761 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:31.762147 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:31.763965 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0a2b27c0-6608-42b0-b12a-5d0078f1f6ad tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.182754 May 12 17:49:31.775425 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 466/930] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:31 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:32.020431 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:32.020958 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:32.029046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.030433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.031496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.031942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.189022 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.197652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3cf6dd46-e337-4f54-bd27-4aa9403e58c6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.181174 May 12 17:49:32.198233 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 465/931] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:32 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:32.545456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a16b579a-d60f-4e81-aac0-e5e8718cd731 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:32.546571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a16b579a-d60f-4e81-aac0-e5e8718cd731 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:32.553975 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a16b579a-d60f-4e81-aac0-e5e8718cd731 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.555060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a16b579a-d60f-4e81-aac0-e5e8718cd731 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.556074 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a16b579a-d60f-4e81-aac0-e5e8718cd731 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.556512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a16b579a-d60f-4e81-aac0-e5e8718cd731 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.587564 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a16b579a-d60f-4e81-aac0-e5e8718cd731 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 May 12 17:49:32.588126 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 467/932] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:32 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:32.786737 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:32.787498 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:32.795306 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.795842 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.796850 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.797334 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.947198 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.955298 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.956792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.957959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c1b13a43-9d5c-43b8-9f8d-dc7b4f4aef59 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.176085 May 12 17:49:32.958736 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 466/933] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:32 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:33.214656 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:33.215659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:33.221668 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.222127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.222934 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.223376 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.366548 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:33.375516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e9129e42-1cd4-4da2-bb4c-b8b4157984f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.165246 May 12 17:49:33.376079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 468/934] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:33 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:33.599349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-345f44da-da92-40dd-9c0b-7293a6c840c3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:33.600510 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-345f44da-da92-40dd-9c0b-7293a6c840c3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:33.607869 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-345f44da-da92-40dd-9c0b-7293a6c840c3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.608328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-345f44da-da92-40dd-9c0b-7293a6c840c3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.609145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-345f44da-da92-40dd-9c0b-7293a6c840c3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.609587 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-345f44da-da92-40dd-9c0b-7293a6c840c3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.640887 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-345f44da-da92-40dd-9c0b-7293a6c840c3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 May 12 17:49:33.641497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 467/935] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:33 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:33.978008 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:33.979292 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:33.988628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.988628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.988628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.989113 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:34.179585 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:34.190441 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:34.195616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:34.197245 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5fea5303-7fd0-4f5c-92e0-0093ee755408 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.224366 May 12 17:49:34.197982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 469/936] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:33 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:34.395642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:34.396396 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:34.402838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:34.403294 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:34.404077 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:34.404517 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:34.558151 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:34.568034 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e47c7145-6829-4e45-a16a-90e452197cd6 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.178347 May 12 17:49:34.569097 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 468/937] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:34 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:34.653799 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-42f0e95f-13f4-43a0-bab6-fcb34ad5212c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:34.654931 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-42f0e95f-13f4-43a0-bab6-fcb34ad5212c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:34.661303 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42f0e95f-13f4-43a0-bab6-fcb34ad5212c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:34.661750 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42f0e95f-13f4-43a0-bab6-fcb34ad5212c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:34.662516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42f0e95f-13f4-43a0-bab6-fcb34ad5212c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:34.662975 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42f0e95f-13f4-43a0-bab6-fcb34ad5212c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:34.693880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-42f0e95f-13f4-43a0-bab6-fcb34ad5212c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043975 May 12 17:49:34.694749 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 470/938] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:34 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:35.215942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:35.216647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:35.223146 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.223608 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.224377 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.224819 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.381942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:35.395223 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:35.396935 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:35.398911 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1e18faee-0a52-4f5d-af28-3a3659ea06c7 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.186181 May 12 17:49:35.399471 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 469/939] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:35 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:35.585487 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:35.587542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:35.598919 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.599526 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.600433 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.600973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.707511 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8b79a3a5-cb44-4c52-b268-77f14a777561 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:35.708781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8b79a3a5-cb44-4c52-b268-77f14a777561 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:35.716259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b79a3a5-cb44-4c52-b268-77f14a777561 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.716843 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b79a3a5-cb44-4c52-b268-77f14a777561 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.718005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b79a3a5-cb44-4c52-b268-77f14a777561 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.718505 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8b79a3a5-cb44-4c52-b268-77f14a777561 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.747794 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:35.755550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b491791c-a6c7-4552-8e5b-075f1265d50b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.174051 May 12 17:49:35.756507 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8b79a3a5-cb44-4c52-b268-77f14a777561 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052864 May 12 17:49:35.758025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 470/940] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:35 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:49:35.763101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 471/941] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:35 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:36.417640 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:36.418244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:36.424941 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.425387 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.426366 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.426834 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.568101 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:36.579689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:36.581403 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:36.582723 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-95917a67-666c-41eb-9618-d6ba1e607194 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.169252 May 12 17:49:36.583451 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 471/942] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:36 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:36.769915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-38825cfc-ec8d-4026-a7be-bdb3bf82c91d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:36.770983 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-38825cfc-ec8d-4026-a7be-bdb3bf82c91d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:36.778733 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:36.779499 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:36.779635 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38825cfc-ec8d-4026-a7be-bdb3bf82c91d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.780167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38825cfc-ec8d-4026-a7be-bdb3bf82c91d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.781159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38825cfc-ec8d-4026-a7be-bdb3bf82c91d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.781691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-38825cfc-ec8d-4026-a7be-bdb3bf82c91d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.787998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.788600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.790299 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.790859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.837692 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-38825cfc-ec8d-4026-a7be-bdb3bf82c91d tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072505 May 12 17:49:36.842115 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 472/943] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:36 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:37.057838 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:37.068642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f9ca0a8e-182b-4290-8c4f-399e9abbb0fa tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.296570 May 12 17:49:37.069729 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 472/944] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:36 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:37.602039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:37.602796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:37.609638 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:37.610183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:37.611099 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:37.611628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:37.787290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:37.797136 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:37.798807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:37.800322 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-89dd9888-87ed-44be-9897-270573610bdd tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.202883 May 12 17:49:37.811209 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 473/945] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:37 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:37.849544 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ff1ac764-207e-44f2-9e63-5f1099d0cfd3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:37.850527 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ff1ac764-207e-44f2-9e63-5f1099d0cfd3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:37.857381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff1ac764-207e-44f2-9e63-5f1099d0cfd3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:37.857833 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff1ac764-207e-44f2-9e63-5f1099d0cfd3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:37.858644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff1ac764-207e-44f2-9e63-5f1099d0cfd3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:37.859096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ff1ac764-207e-44f2-9e63-5f1099d0cfd3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:37.890503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ff1ac764-207e-44f2-9e63-5f1099d0cfd3 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 May 12 17:49:37.891115 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 473/946] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:37 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:38.088155 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:38.088773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:38.094955 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.095475 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.096413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.096928 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.249996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:38.257410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-35e2aa5c-c583-4345-8a25-b98363349513 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.173725 May 12 17:49:38.258164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 474/947] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:38 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:38.824024 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:38.824705 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:38.834375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.834910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.835878 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.836580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.903343 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d162e78d-9828-4a2d-891d-e2f1eb3d4436 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:38.904183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d162e78d-9828-4a2d-891d-e2f1eb3d4436 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:38.910782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d162e78d-9828-4a2d-891d-e2f1eb3d4436 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.911237 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d162e78d-9828-4a2d-891d-e2f1eb3d4436 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.912026 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d162e78d-9828-4a2d-891d-e2f1eb3d4436 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.912464 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d162e78d-9828-4a2d-891d-e2f1eb3d4436 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.950199 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d162e78d-9828-4a2d-891d-e2f1eb3d4436 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052154 May 12 17:49:38.950809 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 475/948] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:38 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:39.004399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:39.015935 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:39.018171 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:39.019408 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-17e53382-bfda-4736-be5b-9dc369c6f5b4 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.201800 May 12 17:49:39.019966 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 474/949] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:38 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:39.277123 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:39.277744 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:39.290646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:39.291202 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:39.292061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:39.292575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:39.444346 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:39.452295 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-75309d6d-cc9f-42c7-96f0-cb4cad584847 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.180124 May 12 17:49:39.452875 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 476/950] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:39 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:39.962409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fb378b00-1968-42cd-8b1e-ad8a5da2b113 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:39.964068 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fb378b00-1968-42cd-8b1e-ad8a5da2b113 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:39.971160 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb378b00-1968-42cd-8b1e-ad8a5da2b113 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:39.971668 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb378b00-1968-42cd-8b1e-ad8a5da2b113 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:39.972454 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb378b00-1968-42cd-8b1e-ad8a5da2b113 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:39.972895 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fb378b00-1968-42cd-8b1e-ad8a5da2b113 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.002979 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fb378b00-1968-42cd-8b1e-ad8a5da2b113 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 May 12 17:49:40.003635 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 475/951] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:39 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:40.042834 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:40.043476 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:40.049758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.050214 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.051030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.051466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.189623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:40.198244 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:40.199808 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:40.200973 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3e3922ed-b76f-4748-93c9-3c879abe02c2 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.163533 May 12 17:49:40.201518 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 477/952] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:40 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:40.471164 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:40.471164 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:40.476812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.478447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.479271 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.479707 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.635465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:40.644282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-70aea0d4-41e8-4cdf-aed2-f7334bd2a802 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.177958 May 12 17:49:40.654124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 476/953] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:40 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:41.015922 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d8e46161-253f-47f8-9e49-b2e948305371 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:41.016846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d8e46161-253f-47f8-9e49-b2e948305371 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:41.022806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d8e46161-253f-47f8-9e49-b2e948305371 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:41.023573 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d8e46161-253f-47f8-9e49-b2e948305371 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:41.024418 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d8e46161-253f-47f8-9e49-b2e948305371 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:41.024856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d8e46161-253f-47f8-9e49-b2e948305371 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:41.053878 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d8e46161-253f-47f8-9e49-b2e948305371 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042109 May 12 17:49:41.054659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 478/954] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:41 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:49:41.219071 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:41.219598 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:41.225931 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:41.226385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:41.227696 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:41.228139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:41.357652 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:41.365392 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:41.367058 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:41.368970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-bb718cc7-0a22-4d49-ba45-a3f834a9af27 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.153914 May 12 17:49:41.369537 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 477/955] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:41 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:41.661359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:41.662065 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:41.669159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:41.669739 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:41.670799 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:41.671413 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:41.803863 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:41.811800 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7ae49d79-bd02-42e4-a4f9-9f0f2ddc2bca tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.154412 May 12 17:49:41.812358 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 479/956] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:41 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:42.066228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-06e98b14-e7a0-4073-a164-b2c1d285c2cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:42.067214 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-06e98b14-e7a0-4073-a164-b2c1d285c2cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:42.073992 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-06e98b14-e7a0-4073-a164-b2c1d285c2cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:42.074468 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-06e98b14-e7a0-4073-a164-b2c1d285c2cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:42.075321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-06e98b14-e7a0-4073-a164-b2c1d285c2cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:42.075755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-06e98b14-e7a0-4073-a164-b2c1d285c2cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:42.105586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-06e98b14-e7a0-4073-a164-b2c1d285c2cf tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043304 May 12 17:49:42.106132 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 478/957] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:42 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:42.386847 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:42.387452 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:42.395191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:42.395642 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:42.396416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:42.396846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:42.524544 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:42.532375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:42.533865 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:42.535034 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b31b7c61-394a-4142-add7-03955fd701af tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.152101 May 12 17:49:42.535572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 480/958] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:42 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:42.829418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:42.830028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:42.836567 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:42.837356 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:42.838147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:42.838590 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:42.972609 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:42.980350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9e22cde8-1c43-4c3c-b46a-064bc22cacff tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.154874 May 12 17:49:42.980910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 479/959] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:42 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:43.117205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f6ae2dec-ce3d-423c-8847-70cbc976f46c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:43.118477 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f6ae2dec-ce3d-423c-8847-70cbc976f46c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:43.125988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6ae2dec-ce3d-423c-8847-70cbc976f46c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.126447 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6ae2dec-ce3d-423c-8847-70cbc976f46c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.127299 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6ae2dec-ce3d-423c-8847-70cbc976f46c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.127851 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f6ae2dec-ce3d-423c-8847-70cbc976f46c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.163090 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f6ae2dec-ce3d-423c-8847-70cbc976f46c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049854 May 12 17:49:43.163647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 481/960] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:43 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:49:43.223458 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:43.223989 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:43.230719 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.231177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.232047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.232493 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.256545 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:49:43.329269 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a1b6df25-91dc-422d-bdd7-ee3991d5cde8 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 204 len: 0 microversion: 2.1 time: 0.109404 May 12 17:49:43.329842 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 480/961] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:49:43 2022] DELETE /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:49:43.338965 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:43.339574 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:43.345301 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.345748 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.346504 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.346963 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.474273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:43.482593 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3d09beee-2878-4775-8d0e-dc74df65ca17 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1681 microversion: 2.1 time: 0.148534 May 12 17:49:43.483167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 482/962] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:43 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:43.553454 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:43.554185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:43.560193 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.560651 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.561419 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.561862 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.689517 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:43.697888 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:43.699443 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:43.700600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c1fb18e6-f894-4899-a2c8-a41ffae3c20f tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.151418 May 12 17:49:43.701160 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 481/963] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:43 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:43.998504 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:43.999066 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:44.004930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.005377 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.006140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.006575 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.140188 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:44.147487 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a159b575-6c04-4745-9d91-64df5f3da3eb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.153422 May 12 17:49:44.148050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 483/964] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:43 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:44.496666 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4379cb7f-a6f5-4af3-9db0-465cb16bb4e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:44.497222 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4379cb7f-a6f5-4af3-9db0-465cb16bb4e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:44.500590 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:44.501801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:44.504087 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4379cb7f-a6f5-4af3-9db0-465cb16bb4e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.504876 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4379cb7f-a6f5-4af3-9db0-465cb16bb4e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.505715 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4379cb7f-a6f5-4af3-9db0-465cb16bb4e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.506407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4379cb7f-a6f5-4af3-9db0-465cb16bb4e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.508345 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.509697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.510538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.511178 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.533614 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4379cb7f-a6f5-4af3-9db0-465cb16bb4e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/ips" status: 200 len: 147 microversion: 2.1 time: 0.041573 May 12 17:49:44.534140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 482/965] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:49:44 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:44.647977 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:44.655830 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-383cb892-209a-4bca-8ab5-8b6b9a656604 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1681 microversion: 2.1 time: 0.159866 May 12 17:49:44.656551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 484/966] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:44 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:44.718806 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:44.719586 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:44.725478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.726008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.726737 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:44.727183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:44.872026 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:44.879967 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:44.881458 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:44.882597 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ae34b2d6-ac60-492f-ad82-ed3bb0dba0d9 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.167870 May 12 17:49:44.883206 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 483/967] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:44 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:45.166348 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:45.166992 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:45.173207 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:45.173659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:45.174427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:45.174958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:45.307288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:45.314564 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1f4feb39-df5e-4822-ac78-a2288010097f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.153163 May 12 17:49:45.315164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 485/968] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:45 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:45.673962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:45.674574 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:45.680950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:45.681401 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:45.682183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:45.682625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:45.812185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:45.820885 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-aeeef118-2d7f-4444-bd45-9385fe1f44c5 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1681 microversion: 2.1 time: 0.150675 May 12 17:49:45.822369 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 484/969] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:45 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:45.901946 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:45.902557 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:45.908905 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:45.909357 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:45.910129 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:45.910562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:46.038474 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:46.046899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:46.048393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:46.049537 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-04910aaf-6d96-4ce5-b8e4-a4f8e5e1096a tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.152125 May 12 17:49:46.050088 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 486/970] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:45 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:46.331936 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:46.332579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:46.339301 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:46.339754 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:46.340521 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:46.340989 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:46.476067 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:46.484516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-21a5ce02-096d-4586-a3f3-812b020c4435 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.156503 May 12 17:49:46.485084 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 485/971] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:46 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:46.839020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:46.839628 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:46.845882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:46.846339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:46.847268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:46.847738 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:46.974868 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:46.982136 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-594ec13c-e00e-455b-adfc-426a4bfe2dde tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1681 microversion: 2.1 time: 0.147713 May 12 17:49:46.982959 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 487/972] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:46 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:47.068199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:47.068908 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:47.076039 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:47.076489 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:47.077248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:47.077682 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:47.206066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:47.213840 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:47.215365 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:47.216516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a597d097-1c28-4a27-8ac2-281794ec66a5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.152213 May 12 17:49:47.217068 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 486/973] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:47 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:47.501562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:47.502085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:47.508030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:47.508996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:47.510311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:47.510788 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:47.662645 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:47.670531 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0eedbfe3-2248-4bda-8601-b4ba673956f2 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.172923 May 12 17:49:47.671171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 488/974] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:47 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:47.687631 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-b7538b4d-179e-4887-b19f-9943baa5fc5c req-15ff0366-9259-46b3-8f88-48e2a4337c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94af4804-8a27-4f9b-b471-7fa1a1dabedf", "name": "network-vif-unplugged", "status": "completed", "tag": "4903dc03-9110-43e6-bfaf-db2e0fe64355"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:47.697994 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-b7538b4d-179e-4887-b19f-9943baa5fc5c req-15ff0366-9259-46b3-8f88-48e2a4337c30 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:47.698536 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-b7538b4d-179e-4887-b19f-9943baa5fc5c req-15ff0366-9259-46b3-8f88-48e2a4337c30 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:47.710759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-b7538b4d-179e-4887-b19f-9943baa5fc5c req-15ff0366-9259-46b3-8f88-48e2a4337c30 service nova] Creating event network-vif-unplugged:4903dc03-9110-43e6-bfaf-db2e0fe64355 for instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf on hv-cinder-83979 May 12 17:49:47.715697 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-b7538b4d-179e-4887-b19f-9943baa5fc5c req-15ff0366-9259-46b3-8f88-48e2a4337c30 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032162 May 12 17:49:47.716292 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 487/975] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:47.966870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fdfea7bb-5a1e-4254-ae42-dbd9f45aa566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ade3b5af-c597-4566-a69f-0dcfe5a8c946"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:47.968126 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-fdfea7bb-5a1e-4254-ae42-dbd9f45aa566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:47.974414 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fdfea7bb-5a1e-4254-ae42-dbd9f45aa566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:47.974915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fdfea7bb-5a1e-4254-ae42-dbd9f45aa566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:47.975705 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fdfea7bb-5a1e-4254-ae42-dbd9f45aa566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:47.976161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fdfea7bb-5a1e-4254-ae42-dbd9f45aa566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.000093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:48.000795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:48.007031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.007486 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.008255 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.009201 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.137393 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:48.144692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ecd688f2-cf2d-427a-954a-c3da88150ca4 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1681 microversion: 2.1 time: 0.148922 May 12 17:49:48.145252 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 488/976] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:47 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:48.237984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:48.237984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:48.240365 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.240590 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.241356 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.241785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.373764 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:48.381485 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:48.383060 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:48.384860 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-63974105-4528-46f8-8e61-59d809126b76 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.154989 May 12 17:49:48.385409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 489/977] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:48 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:49:48.687439 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:48.688050 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:48.693953 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.694407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.695205 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.695646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.823423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:48.830710 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-08d7958b-d9be-4d59-8ba8-9689f624b030 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.147113 May 12 17:49:48.831280 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 490/978] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:48 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:49.162947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:49.163613 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:49.170598 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.171080 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.171834 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.172263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.299144 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:49.306503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0646f47f-4d52-4039-831f-38c53760703c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1681 microversion: 2.1 time: 0.147408 May 12 17:49:49.307096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 491/979] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:49 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:49.404144 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:49.404747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:49.410469 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.410946 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.411697 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.412127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.545407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:49.553173 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:49.554688 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:49.556554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-df46de27-6dd5-4c4b-a758-386806748938 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.157169 May 12 17:49:49.557112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 492/980] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:49 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:49:49.847504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:49.848105 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:49.855169 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.855620 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.856381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.856814 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.991339 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:49.998661 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8222151c-3f37-4490-93ab-7e342557ec73 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.155042 May 12 17:49:49.999245 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 493/981] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:49 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:50.324423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:50.325025 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:50.331334 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:50.331780 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:50.332538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:50.332963 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:50.462554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:50.469965 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8e0d04e4-b63b-4c67-9f89-5dc845c27d81 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1681 microversion: 2.1 time: 0.150315 May 12 17:49:50.470528 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 494/982] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:50 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:50.574948 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:50.575556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:50.581308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:50.581752 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:50.582503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:50.582960 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:50.711965 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:50.719700 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:50.721196 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:50.722377 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ce92feef-518c-46d9-9cf2-676a8e0c2fa0 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.151853 May 12 17:49:50.722959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 495/983] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:50 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:49:51.000177 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-fdfea7bb-5a1e-4254-ae42-dbd9f45aa566 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.036867 May 12 17:49:51.001423 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 489/984] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:49:47 2022] POST /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments => generated 194 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:51.015695 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:51.016417 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:51.022696 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.024136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.025826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.026421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.174696 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:51.188701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-dcba80af-a628-4a9a-a679-54f9d88d1420 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.176743 May 12 17:49:51.189477 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 496/985] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:51 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:51.206560 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-7d3ae903-a54b-4856-bd1c-b60ee1bc34f3 req-402b3df7-acfc-4c2d-a373-097effcec2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67972c22-858c-41e6-85f9-27327673af00", "name": "network-vif-plugged", "status": "completed", "tag": "143d4171-1885-4746-8f1e-a6334c3f41fe"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:51.220460 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-7d3ae903-a54b-4856-bd1c-b60ee1bc34f3 req-402b3df7-acfc-4c2d-a373-097effcec2f6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.221141 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-7d3ae903-a54b-4856-bd1c-b60ee1bc34f3 req-402b3df7-acfc-4c2d-a373-097effcec2f6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.239726 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-7d3ae903-a54b-4856-bd1c-b60ee1bc34f3 req-402b3df7-acfc-4c2d-a373-097effcec2f6 service nova] Creating event network-vif-plugged:143d4171-1885-4746-8f1e-a6334c3f41fe for instance 67972c22-858c-41e6-85f9-27327673af00 on hv-cinder-83979 May 12 17:49:51.246068 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-7d3ae903-a54b-4856-bd1c-b60ee1bc34f3 req-402b3df7-acfc-4c2d-a373-097effcec2f6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045108 May 12 17:49:51.247172 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 490/986] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:51.487411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:51.488107 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:51.495886 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.496337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.497329 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.497770 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.568244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:51.576899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-578340d6-7bef-49c3-aa77-bd196498c9a7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1613 microversion: 2.1 time: 0.093548 May 12 17:49:51.577413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 497/987] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:51 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:51.741467 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:51.742421 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:51.750971 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.751809 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.752770 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.753365 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.876421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-b6936328-af0c-45d9-92e1-fff30a21a5c1 req-43ce9341-a93c-46a8-a56e-0c138f376838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1dbd33a-296d-424f-931d-cbf3fb15edca", "name": "network-vif-deleted", "tag": "43cef85c-a437-458e-8aca-ac2d59280f87"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:51.887614 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-b6936328-af0c-45d9-92e1-fff30a21a5c1 req-43ce9341-a93c-46a8-a56e-0c138f376838 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:51.889919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-b6936328-af0c-45d9-92e1-fff30a21a5c1 req-43ce9341-a93c-46a8-a56e-0c138f376838 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:51.917055 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-b6936328-af0c-45d9-92e1-fff30a21a5c1 req-43ce9341-a93c-46a8-a56e-0c138f376838 service nova] Creating event network-vif-deleted:43cef85c-a437-458e-8aca-ac2d59280f87 for instance d1dbd33a-296d-424f-931d-cbf3fb15edca on hv-cinder-83979 May 12 17:49:51.922582 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-b6936328-af0c-45d9-92e1-fff30a21a5c1 req-43ce9341-a93c-46a8-a56e-0c138f376838 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048438 May 12 17:49:51.926594 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 498/988] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:49:51.954241 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:51.966743 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:51.968909 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:51.971990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-5a7eac12-4b61-42a8-ae3b-000116fb992c tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.234744 May 12 17:49:51.973257 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 491/989] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:51 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:52.206201 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:52.206944 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:52.215116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.215853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.216815 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.217300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.594260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:52.594915 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:52.601858 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.602318 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.603223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.603654 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.608533 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:52.618454 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2d3e733e-046f-45c8-93c8-db259a335ff4 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1508 microversion: 2.1 time: 0.416271 May 12 17:49:52.619693 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 499/990] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:52 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:52.637625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0246c55a-6dda-4694-a33a-2700d43876ec tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:52.639035 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0246c55a-6dda-4694-a33a-2700d43876ec tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:52.649028 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.650664 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.651346 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lazy-loading 'fault' on Instance uuid d1dbd33a-296d-424f-931d-cbf3fb15edca {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:49:52.652775 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0246c55a-6dda-4694-a33a-2700d43876ec tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.653244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0246c55a-6dda-4694-a33a-2700d43876ec tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.654236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0246c55a-6dda-4694-a33a-2700d43876ec tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.654892 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0246c55a-6dda-4694-a33a-2700d43876ec tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.701105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1708b4ee7e43afaac75452be3b195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38aae8b9be064fabb6e07ea34a5dcdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:52.711097 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-25ade46d-fe68-4b36-b9eb-b82429a333e7 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 200 len: 1331 microversion: 2.1 time: 0.120794 May 12 17:49:52.712251 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 492/991] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:52 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:52.750410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0246c55a-6dda-4694-a33a-2700d43876ec tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "POST /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf/action" status: 202 len: 0 microversion: 2.1 time: 0.119243 May 12 17:49:52.752020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 500/992] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:49:52 2022] POST /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:49:52.761288 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:52.762255 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:52.768562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.769017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.769801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.770239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:52.949456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:52.957142 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1f06bdb6-e249-46fb-b30a-99fa3c39ffe3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1516 microversion: 2.1 time: 0.200750 May 12 17:49:52.957715 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 493/993] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:52 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:52.991324 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:52.991937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:52.999127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:52.999802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:53.000921 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:53.001820 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:53.160756 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:53.182144 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:53.183609 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:53.184786 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-74dd7d37-1d32-4801-8875-df7c4d3b1244 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1731 microversion: 2.20 time: 0.197340 May 12 17:49:53.188426 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 501/994] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:52 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:53.729877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:53.730498 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:53.737497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:53.738054 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:53.738865 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:53.739364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:53.755056 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca HTTP/1.1 May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:49:53.757160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:53.758732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'd1dbd33a-296d-424f-931d-cbf3fb15edca'} May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:53.759662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:53.761035 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:53.762293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:53.762293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-7819eb31-23ee-47dd-987d-e227fb2d33df tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 404 len: 111 microversion: 2.1 time: 0.033464 May 12 17:49:53.762293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 494/995] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:53 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:53.768635 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e6860ae6-82a2-4bbc-981b-bf6fcaa0a4fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '.version_select at 0x7f24bc2255e0>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:53.787363 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e6860ae6-82a2-4bbc-981b-bf6fcaa0a4fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614743144" status: 202 len: 0 microversion: 2.1 time: 0.022863 May 12 17:49:53.787932 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 502/996] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 12 17:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614743144 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:49:53.976471 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:53.978009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:53.985576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:53.986029 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:53.986867 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:53.987302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:54.122290 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:54.129714 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a152bb7d-59d1-474d-a9e7-4310394e2260 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1518 microversion: 2.1 time: 0.157788 May 12 17:49:54.130280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 495/997] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:53 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:54.202913 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:54.203521 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:54.209519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:54.209979 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:54.210871 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:54.211313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:54.437572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:54.445880 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:54.448116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:54.449311 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-590aa8e6-dc21-4829-ac1a-4dd49cee59dc tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1718 microversion: 2.20 time: 0.250420 May 12 17:49:54.450044 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 503/998] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:49:54 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1718 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:55.146965 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:55.147613 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:55.154874 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.155328 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.156124 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.156561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.291846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:55.299596 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-80219ee0-e5e1-42e9-9c4f-dab61b8e5e3c tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1518 microversion: 2.1 time: 0.156524 May 12 17:49:55.300163 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 496/999] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:55 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:55.619031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:55.619564 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:55.625850 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.626303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.627095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.627533 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.640553 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca HTTP/1.1 May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:49:55.642236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.643731 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': 'd1dbd33a-296d-424f-931d-cbf3fb15edca'} May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:55.644453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.645664 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:55.646893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:55.646893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4e282000-235c-48ef-a8b4-05c2d5bce7fc tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 404 len: 111 microversion: 2.1 time: 0.029175 May 12 17:49:55.646893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 504/1000] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:49:55 2022] DELETE /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:55.652458 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:55.653092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: d1dbd33a-296d-424f-931d-cbf3fb15edca] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:55.658999 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.659457 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.660229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.660670 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.674278 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca HTTP/1.1 May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:49:55.675877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.677410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'd1dbd33a-296d-424f-931d-cbf3fb15edca'} May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:55.678409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. May 12 17:49:55.679862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:55.682573 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance d1dbd33a-296d-424f-931d-cbf3fb15edca could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:55.682573 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b62168c1-3040-4ef3-82a7-ea17e783f170 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca" status: 404 len: 111 microversion: 2.1 time: 0.028949 May 12 17:49:55.682573 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 497/1001] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:55 2022] GET /compute/v2.1/servers/d1dbd33a-296d-424f-931d-cbf3fb15edca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:56.316802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:56.317412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:56.323399 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.323852 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.324626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.325066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.456074 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:56.463418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9fe88c41-591f-4628-a37d-c2a00a4b6bcc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1518 microversion: 2.1 time: 0.150517 May 12 17:49:56.463973 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 505/1002] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:56 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:56.809532 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:56.810029 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:56.816334 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.816798 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.817572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.818015 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.831760 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: DELETE /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 HTTP/1.1 May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:49:56.833298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.834926 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '8fd7e68e-d36e-4be7-83e3-e12e7df966b5'} May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:56.835862 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.837253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.838595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:56.838595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8970f27c-bcb9-41f6-94fa-9d67d42578de tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 404 len: 111 microversion: 2.1 time: 0.029574 May 12 17:49:56.838595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 498/1003] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:49:56 2022] DELETE /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:56.843523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:56.844158 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 8fd7e68e-d36e-4be7-83e3-e12e7df966b5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:56.850407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.850891 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.851647 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.852076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.865264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 HTTP/1.1 May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:49:56.866802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.868914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '8fd7e68e-d36e-4be7-83e3-e12e7df966b5'} May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:56.869844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. May 12 17:49:56.871446 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.872987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 8fd7e68e-d36e-4be7-83e3-e12e7df966b5 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:56.872987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-dcdf2aa2-f805-4669-8014-e64a4ae78207 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5" status: 404 len: 111 microversion: 2.1 time: 0.028466 May 12 17:49:56.872987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 506/1004] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:56 2022] GET /compute/v2.1/servers/8fd7e68e-d36e-4be7-83e3-e12e7df966b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:56.877421 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:56.877920 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:56.884781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.885260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.886036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.886480 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.899796 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: DELETE /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 HTTP/1.1 May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:49:56.901397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.903050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '05a5023a-5da1-4a91-a0ad-0775ff136725'} May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:56.904050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.905549 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:56.907052 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:56.907052 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-bb0f5b8f-165c-49ee-b00e-fe353a083447 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 404 len: 111 microversion: 2.1 time: 0.029193 May 12 17:49:56.907052 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 499/1005] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:49:56 2022] DELETE /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:56.911124 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:56.911733 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 05a5023a-5da1-4a91-a0ad-0775ff136725] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:56.917680 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.918133 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.918929 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.919372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.932960 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 HTTP/1.1 May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:49:56.934487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.936219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '05a5023a-5da1-4a91-a0ad-0775ff136725'} May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:56.937282 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. May 12 17:49:56.938790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:56.940218 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 05a5023a-5da1-4a91-a0ad-0775ff136725 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:56.940218 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-30b75481-8e2c-4f08-a385-14909c82f03b tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725" status: 404 len: 111 microversion: 2.1 time: 0.028557 May 12 17:49:56.940218 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 507/1006] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:56 2022] GET /compute/v2.1/servers/05a5023a-5da1-4a91-a0ad-0775ff136725 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:57.481020 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:57.482087 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:57.489211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:57.489820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:57.490902 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:57.491416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:57.638658 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:57.646861 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2a837244-80e1-4fd9-84fd-9f46f4ec89bd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1518 microversion: 2.1 time: 0.170530 May 12 17:49:57.647426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 500/1007] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:57 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:58.066214 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.066734 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.073264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.073718 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.074487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.074961 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.088482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 HTTP/1.1 May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:49:58.090056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.091429 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '70784c5b-3ded-4e8a-ab43-6e738bf4eea5'} May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:58.092155 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.093375 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:49:58.094657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:58.094657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e3c83e67-1c61-49af-873f-cb43a2bf816c tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "DELETE /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 404 len: 111 microversion: 2.1 time: 0.029054 May 12 17:49:58.094657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 508/1008] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:49:58 2022] DELETE /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:58.100052 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.100732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] [instance: 70784c5b-3ded-4e8a-ab43-6e738bf4eea5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.108086 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.108540 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.109307 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.109744 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.122789 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] HTTP exception thrown: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Request method failure captured: May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 HTTP/1.1 May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUce_XQ_6mhZcaN5eQlrzfeMV_ilctwj-OF3S375AfFpndGnAfamlqZ0z5vjAsIEScvbukf87oknnFdrX00z5zp6Oqb6-CXkIZdpuqj6y6KSMM2fMGC9bUF4Hi9YCpv3KYRUlv3d4SBbqnABr2UTdMza2eZoShG7hOauQEq-RbYN0eg May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:49:58.124311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38aae8b9be064fabb6e07ea34a5dcdb9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38aae8b9be064fabb6e07ea34a5dcdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 38aae8b9be064fabb6e07ea34a5dcdb9 May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-142165757 May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: ac1708b4ee7e43afaac75452be3b195e May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeNegativeTest-142165757-project May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.125900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '70784c5b-3ded-4e8a-ab43-6e738bf4eea5'} May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:58.126820 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. May 12 17:49:58.128298 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:49:58.129713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] Returning 404 to user: Instance 70784c5b-3ded-4e8a-ab43-6e738bf4eea5 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:58.129713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-039f74a6-d2d6-4dd2-aad3-3a1e34d39d54 tempest-AttachVolumeNegativeTest-142165757 tempest-AttachVolumeNegativeTest-142165757-project] 10.222.0.76 "GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5" status: 404 len: 111 microversion: 2.1 time: 0.029461 May 12 17:49:58.129713 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 501/1009] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:58 2022] GET /compute/v2.1/servers/70784c5b-3ded-4e8a-ab43-6e738bf4eea5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:58.585074 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b940a6b8-1e25-46c6-8575-f18c390b85c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.586056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b940a6b8-1e25-46c6-8575-f18c390b85c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.592528 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b940a6b8-1e25-46c6-8575-f18c390b85c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.592984 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b940a6b8-1e25-46c6-8575-f18c390b85c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.593767 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b940a6b8-1e25-46c6-8575-f18c390b85c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.594208 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b940a6b8-1e25-46c6-8575-f18c390b85c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.624819 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b940a6b8-1e25-46c6-8575-f18c390b85c0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 May 12 17:49:58.625379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 509/1010] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:49:58 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:58.635728 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-de5c92b4-e181-4f61-a25c-e3976e558e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.636232 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-de5c92b4-e181-4f61-a25c-e3976e558e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.642353 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de5c92b4-e181-4f61-a25c-e3976e558e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.642853 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de5c92b4-e181-4f61-a25c-e3976e558e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.643769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de5c92b4-e181-4f61-a25c-e3976e558e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.644204 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de5c92b4-e181-4f61-a25c-e3976e558e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.663810 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.664689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.671374 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.672115 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.673030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.673474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.676271 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-de5c92b4-e181-4f61-a25c-e3976e558e59 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/ade3b5af-c597-4566-a69f-0dcfe5a8c946" status: 200 len: 194 microversion: 2.1 time: 0.044945 May 12 17:49:58.676999 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 502/1011] 10.222.0.76 () {58 vars in 1412 bytes} [Thu May 12 17:49:58 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/ade3b5af-c597-4566-a69f-0dcfe5a8c946 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:58.928272 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:58.937839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-da05a58e-96b2-43c9-a858-3b3e50cfc8fb tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1518 microversion: 2.1 time: 0.277755 May 12 17:49:58.948423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 510/1012] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:58 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1518 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:59.956009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:59.956706 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:59.973203 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:59.973667 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:59.974477 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:59.975086 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:00.123786 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:00.132204 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6d385428-b35c-4839-9855-dcef4b1d79f3 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1518 microversion: 2.1 time: 0.180140 May 12 17:50:00.132899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 503/1013] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:49:59 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:01.076176 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-979f2307-fb7b-40c3-81de-73cfe2b042d1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ad1b587-0e66-46e6-96dc-ce39e1ed95fa"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:01.077235 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-979f2307-fb7b-40c3-81de-73cfe2b042d1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:01.083685 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-979f2307-fb7b-40c3-81de-73cfe2b042d1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.084147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-979f2307-fb7b-40c3-81de-73cfe2b042d1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.084934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-979f2307-fb7b-40c3-81de-73cfe2b042d1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.085371 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-979f2307-fb7b-40c3-81de-73cfe2b042d1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.149649 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:01.150732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:01.173207 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.174048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.175115 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.175720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.402813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-979f2307-fb7b-40c3-81de-73cfe2b042d1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "POST /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330971 May 12 17:50:01.403699 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 511/1014] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:50:01 2022] POST /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:01.505633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:01.513492 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-50c9b9e6-685f-4129-b80f-38b047815da5 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.368066 May 12 17:50:01.514249 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 504/1015] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:01 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:02.532762 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:02.534153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:02.542372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:02.543107 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:02.543985 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:02.544520 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:02.691660 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:02.699725 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-10d7e2d1-da17-42f8-be8e-4eee4d10c8cc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.172203 May 12 17:50:02.700413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 512/1016] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:02 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:03.330916 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b394d36f-dd56-4a1e-96a4-10b6e98f29e2 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Action: 'create', calling method: .version_select at 0x7f24bc1b3ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-65034738"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:03.622360 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b394d36f-dd56-4a1e-96a4-10b6e98f29e2 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.401866 May 12 17:50:03.631048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 505/1017] 10.222.0.76 () {60 vars in 1154 bytes} [Thu May 12 17:50:03 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 409 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 17:50:03.633987 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2d7a644f-1ae8-406c-8a8a-77abfa129a57 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc225310>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:03.688950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2d7a644f-1ae8-406c-8a8a-77abfa129a57 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1" status: 200 len: 343 microversion: 2.1 time: 0.058952 May 12 17:50:03.689525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 513/1018] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:50:03 2022] GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 => generated 343 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:03.718008 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:03.718459 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:03.725071 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:03.725514 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:03.726275 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:03.726732 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:03.863430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:03.872309 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-43876ba0-98d6-4616-af1d-8f6894495f0f tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.158497 May 12 17:50:03.873547 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 506/1019] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:03 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:04.702117 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-86f39d11-f86e-4cb7-8462-8ec0e3bb7e74 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc16f700>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:04.749650 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-86f39d11-f86e-4cb7-8462-8ec0e3bb7e74 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1" status: 200 len: 344 microversion: 2.1 time: 0.051704 May 12 17:50:04.751249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 514/1020] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:50:04 2022] GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:04.761799 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9f89f54e-52f7-48b8-b499-1bb2e789f340 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Action: 'create', calling method: .version_select at 0x7f24bc1b3b80>, body: {"snapshot": {"volume_id": "d27c6f20-31b7-441b-8dcd-d721beeab8e1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-160750236"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:04.891038 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:04.891641 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:04.909008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:04.909702 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:04.910554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:04.911034 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:04.922753 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9f89f54e-52f7-48b8-b499-1bb2e789f340 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.164806 May 12 17:50:04.923957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 507/1021] 10.222.0.76 () {60 vars in 1161 bytes} [Thu May 12 17:50:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:04.933751 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-630fdde9-0950-47e1-a98e-3b7aa1b8464d tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc19aee0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:04.977105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-630fdde9-0950-47e1-a98e-3b7aa1b8464d tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 200 len: 286 microversion: 2.1 time: 0.047643 May 12 17:50:04.977880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 508/1022] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 12 17:50:04 2022] GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:04.988426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a2ea1589-2b11-443a-a085-396b86b339b6 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc19a8b0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:05.025188 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a2ea1589-2b11-443a-a085-396b86b339b6 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040449 May 12 17:50:05.025810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 509/1023] 10.222.0.76 () {58 vars in 1139 bytes} [Thu May 12 17:50:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:05.037383 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3eee6a08-d628-45d8-b7e0-4a5e6e9a3ef0 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc1b3550>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:05.063461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:05.070634 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6ce3880b-2296-4a26-af0c-bde2bebcb515 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.184700 May 12 17:50:05.071844 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 515/1024] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:04 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:05.082462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3eee6a08-d628-45d8-b7e0-4a5e6e9a3ef0 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 200 len: 286 microversion: 2.1 time: 0.049348 May 12 17:50:05.083136 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 510/1025] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 12 17:50:05 2022] GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:06.088260 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:06.088880 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:06.094225 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2de6669f-b1d1-489e-9510-accf02dd0b36 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc19a3a0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:06.110196 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:06.111113 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:06.111472 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:06.111909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:06.125991 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2de6669f-b1d1-489e-9510-accf02dd0b36 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 200 len: 286 microversion: 2.1 time: 0.035951 May 12 17:50:06.126615 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 511/1026] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 12 17:50:06 2022] GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:06.256679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:06.264949 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fe45742c-beee-49f5-ab00-e8ffde875ebc tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.180655 May 12 17:50:06.265512 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 516/1027] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:06 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:07.138252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-82910eef-d7eb-42e2-9a9c-00811b9bfca9 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc1e1c10>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:07.170625 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-82910eef-d7eb-42e2-9a9c-00811b9bfca9 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 200 len: 286 microversion: 2.1 time: 0.036857 May 12 17:50:07.171229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 512/1028] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 12 17:50:07 2022] GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:07.283207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:07.283969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:07.291622 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:07.292277 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:07.293239 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:07.293841 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:07.434991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:07.442288 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-cc396f8e-f7a3-4b49-ad21-707710ed046a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.163069 May 12 17:50:07.442966 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 517/1029] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:07 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:08.182026 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2bdfe286-14ba-411f-a81f-8bcffd6b9721 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc19aee0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:08.212542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2bdfe286-14ba-411f-a81f-8bcffd6b9721 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 200 len: 287 microversion: 2.1 time: 0.034265 May 12 17:50:08.213459 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 513/1030] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 12 17:50:08 2022] GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:08.223569 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-573adc5c-7fa1-4fb3-a9be-c7d42e99ef54 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc16f820>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:08.282642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-573adc5c-7fa1-4fb3-a9be-c7d42e99ef54 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 202 len: 0 microversion: 2.1 time: 0.062793 May 12 17:50:08.283245 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 518/1031] 10.222.0.76 () {58 vars in 1253 bytes} [Thu May 12 17:50:08 2022] DELETE /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:50:08.291781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d5cb2947-a239-4d4f-bde1-c7773d3d6996 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc1b3ee0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:08.319835 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d5cb2947-a239-4d4f-bde1-c7773d3d6996 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 200 len: 286 microversion: 2.1 time: 0.032163 May 12 17:50:08.320401 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 514/1032] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 12 17:50:08 2022] GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:08.462407 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:08.463154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:08.471305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:08.471774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:08.472603 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:08.473263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:08.615825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:08.623917 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8e21ed57-1025-48e1-bf1e-70a03d4b2e43 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.167694 May 12 17:50:08.624478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 519/1033] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:08 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:09.331595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fdfa6fa2-0c28-43c9-bed7-b1d74833a5d1 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc1e18b0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:09.356743 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-fdfa6fa2-0c28-43c9-bed7-b1d74833a5d1 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] HTTP exception thrown: Snapshot 7501d23e-5e80-4790-92e5-5b3be3df0e7e could not be found. May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fdfa6fa2-0c28-43c9-bed7-b1d74833a5d1 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Request method failure captured: May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e HTTP/1.1 May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUjLu7I_58sqvV1mfQXGZzTG2LpdIpV2wGzDYHkvvmMfcsIU891yA8O04QkEESV9VugmA6oEc1H-7jApwNKZiuzZctt02N-5l9AfIU2O9mZFnYjGx4UIHUsn35w6MFVFRCie09f3zUam6bu98VuFiqUW-_5JTQRGutPJfiVhic8NN_E May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:50:09.362936 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a3abc0370bfc48f888453b4c56ee15e5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 0300aa7787b6433b9003e46ff0853758 May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Snapshot 7501d23e-5e80-4790-92e5-5b3be3df0e7e could not be found. May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '7501d23e-5e80-4790-92e5-5b3be3df0e7e'} May 12 17:50:09.364517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7501d23e-5e80-4790-92e5-5b3be3df0e7e could not be found. (HTTP 404) (Request-ID: req-1ad7e258-4c6e-4102-9911-c75103c5bd38) May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:09.365551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:50:09.366745 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7501d23e-5e80-4790-92e5-5b3be3df0e7e could not be found. May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 17:50:09.368144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7501d23e-5e80-4790-92e5-5b3be3df0e7e could not be found. May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7501d23e-5e80-4790-92e5-5b3be3df0e7e could not be found. May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fdfa6fa2-0c28-43c9-bed7-b1d74833a5d1 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Returning 404 to user: Snapshot 7501d23e-5e80-4790-92e5-5b3be3df0e7e could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:09.369746 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-fdfa6fa2-0c28-43c9-bed7-b1d74833a5d1 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e" status: 404 len: 111 microversion: 2.1 time: 0.037105 May 12 17:50:09.370828 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 515/1034] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 12 17:50:09 2022] GET /compute/v2.1/os-snapshots/7501d23e-5e80-4790-92e5-5b3be3df0e7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:09.373410 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7f9ffcb3-e4ac-4a36-9f45-43e0e6fcd39b tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc16f820>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:09.433314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7f9ffcb3-e4ac-4a36-9f45-43e0e6fcd39b tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1" status: 202 len: 0 microversion: 2.1 time: 0.063587 May 12 17:50:09.433884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 520/1035] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:50:09 2022] DELETE /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:50:09.442367 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4dac0074-39c1-40c1-baa2-e3be5f7825cc tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc1e1af0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:09.491304 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4dac0074-39c1-40c1-baa2-e3be5f7825cc tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1" status: 200 len: 343 microversion: 2.1 time: 0.052719 May 12 17:50:09.491818 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 516/1036] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:50:09 2022] GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 => generated 343 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:09.641689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:09.642318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:09.650703 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:09.651427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:09.652394 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:09.653016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:09.814972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:09.822447 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8c3ab2da-8871-4666-b49f-ab025a4f8c20 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.185233 May 12 17:50:09.823139 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 521/1037] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:09 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:10.012117 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-84fe84ea-00c6-45c0-8f61-7da90dbd2829 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.013027 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-84fe84ea-00c6-45c0-8f61-7da90dbd2829 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:10.019504 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-84fe84ea-00c6-45c0-8f61-7da90dbd2829 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.019957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-84fe84ea-00c6-45c0-8f61-7da90dbd2829 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.020724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-84fe84ea-00c6-45c0-8f61-7da90dbd2829 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.021160 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-84fe84ea-00c6-45c0-8f61-7da90dbd2829 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.056752 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-84fe84ea-00c6-45c0-8f61-7da90dbd2829 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048859 May 12 17:50:10.057305 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 517/1038] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:50:10 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:10.199032 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fc0ba106-3935-45f3-9151-5e4bf4e9deb1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.199526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fc0ba106-3935-45f3-9151-5e4bf4e9deb1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:10.205456 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fc0ba106-3935-45f3-9151-5e4bf4e9deb1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.205907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fc0ba106-3935-45f3-9151-5e4bf4e9deb1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.206689 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fc0ba106-3935-45f3-9151-5e4bf4e9deb1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.207127 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fc0ba106-3935-45f3-9151-5e4bf4e9deb1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.236792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fc0ba106-3935-45f3-9151-5e4bf4e9deb1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/ade3b5af-c597-4566-a69f-0dcfe5a8c946" status: 200 len: 194 microversion: 2.1 time: 0.041887 May 12 17:50:10.237379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 522/1039] 10.222.0.76 () {58 vars in 1412 bytes} [Thu May 12 17:50:10 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/ade3b5af-c597-4566-a69f-0dcfe5a8c946 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:10.247005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.247473 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:10.253443 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.253900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.254691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.255133 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.333827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lazy-loading 'services' on Instance uuid 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:50:10.409241 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-448d4db9-cebf-4694-b5a9-29591a7ee299 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/ade3b5af-c597-4566-a69f-0dcfe5a8c946" status: 202 len: 0 microversion: 2.1 time: 0.166069 May 12 17:50:10.409886 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 518/1040] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:50:10 2022] DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/ade3b5af-c597-4566-a69f-0dcfe5a8c946 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:50:10.503755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7e368340-b537-4b61-b9d2-90f796e68492 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc37fa60>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.531575 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-7e368340-b537-4b61-b9d2-90f796e68492 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] HTTP exception thrown: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7e368340-b537-4b61-b9d2-90f796e68492 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Request method failure captured: May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 HTTP/1.1 May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUjLu7I_58sqvV1mfQXGZzTG2LpdIpV2wGzDYHkvvmMfcsIU891yA8O04QkEESV9VugmA6oEc1H-7jApwNKZiuzZctt02N-5l9AfIU2O9mZFnYjGx4UIHUsn35w6MFVFRCie09f3zUam6bu98VuFiqUW-_5JTQRGutPJfiVhic8NN_E May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:50:10.533644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a3abc0370bfc48f888453b4c56ee15e5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 0300aa7787b6433b9003e46ff0853758 May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': 'd27c6f20-31b7-441b-8dcd-d721beeab8e1'} May 12 17:50:10.535383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. (HTTP 404) (Request-ID: req-563b0948-486e-4c1d-b1c9-b34b792faf67) May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.539309 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:50:10.540816 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:50:10.542192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7e368340-b537-4b61-b9d2-90f796e68492 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Returning 404 to user: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7e368340-b537-4b61-b9d2-90f796e68492 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1" status: 404 len: 109 microversion: 2.1 time: 0.035254 May 12 17:50:10.544318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 523/1041] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:50:10 2022] GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:10.550783 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-911dafe5-3052-44f9-90e0-a37d79d5ff58 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc2b6f70>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.579469 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-911dafe5-3052-44f9-90e0-a37d79d5ff58 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] HTTP exception thrown: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-911dafe5-3052-44f9-90e0-a37d79d5ff58 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Request method failure captured: May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: DELETE /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 HTTP/1.1 May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUjLu7I_58sqvV1mfQXGZzTG2LpdIpV2wGzDYHkvvmMfcsIU891yA8O04QkEESV9VugmA6oEc1H-7jApwNKZiuzZctt02N-5l9AfIU2O9mZFnYjGx4UIHUsn35w6MFVFRCie09f3zUam6bu98VuFiqUW-_5JTQRGutPJfiVhic8NN_E May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:50:10.581889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a3abc0370bfc48f888453b4c56ee15e5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 0300aa7787b6433b9003e46ff0853758 May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'd27c6f20-31b7-441b-8dcd-d721beeab8e1'} May 12 17:50:10.583570 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. (HTTP 404) (Request-ID: req-8a29b583-b43c-4f3c-b02a-01742bee7347) May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.584580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:50:10.585741 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:50:10.588140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-911dafe5-3052-44f9-90e0-a37d79d5ff58 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Returning 404 to user: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:10.589297 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-911dafe5-3052-44f9-90e0-a37d79d5ff58 tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1" status: 404 len: 109 microversion: 2.1 time: 0.037138 May 12 17:50:10.590098 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 519/1042] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 12 17:50:10 2022] DELETE /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:10.592348 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-62daee67-4499-42b9-ab9d-d91af7a01b6c tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Calling method '.version_select at 0x7f24bc2c3790>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.619565 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-62daee67-4499-42b9-ab9d-d91af7a01b6c tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] HTTP exception thrown: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-62daee67-4499-42b9-ab9d-d91af7a01b6c tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Request method failure captured: May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 HTTP/1.1 May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUjLu7I_58sqvV1mfQXGZzTG2LpdIpV2wGzDYHkvvmMfcsIU891yA8O04QkEESV9VugmA6oEc1H-7jApwNKZiuzZctt02N-5l9AfIU2O9mZFnYjGx4UIHUsn35w6MFVFRCie09f3zUam6bu98VuFiqUW-_5JTQRGutPJfiVhic8NN_E May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:50:10.621542 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a3abc0370bfc48f888453b4c56ee15e5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a3abc0370bfc48f888453b4c56ee15e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: a3abc0370bfc48f888453b4c56ee15e5 May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966192681 May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 0300aa7787b6433b9003e46ff0853758 May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966192681-project May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': 'd27c6f20-31b7-441b-8dcd-d721beeab8e1'} May 12 17:50:10.623172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. (HTTP 404) (Request-ID: req-5e75c49f-36e5-4cb1-b54b-84b0b4fe2d01) May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.624279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:50:10.625656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:50:10.627321 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-62daee67-4499-42b9-ab9d-d91af7a01b6c tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] Returning 404 to user: Volume d27c6f20-31b7-441b-8dcd-d721beeab8e1 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-62daee67-4499-42b9-ab9d-d91af7a01b6c tempest-VolumesSnapshotsTestJSON-1966192681 tempest-VolumesSnapshotsTestJSON-1966192681-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1" status: 404 len: 109 microversion: 2.1 time: 0.034341 May 12 17:50:10.628774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 524/1043] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 12 17:50:10 2022] GET /compute/v2.1/os-volumes/d27c6f20-31b7-441b-8dcd-d721beeab8e1 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:10.840785 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.841500 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:10.848242 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.848697 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.849701 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.850144 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.996474 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:11.003846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-42a0b2c5-7868-469b-aa1b-3ddd3c82cfd8 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.168169 May 12 17:50:11.004403 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 520/1044] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:10 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:12.021133 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:12.021732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:12.028413 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:12.028859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:12.029617 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:12.030048 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:12.168965 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:12.179028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-030e83ea-f9c7-4b84-a906-95d1a166e459 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.162091 May 12 17:50:12.179600 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 525/1045] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:12 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:13.197773 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:13.198337 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:13.204649 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.205106 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.205875 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.206311 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.341542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:13.348836 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a8aa5e33-970a-472b-a185-e0fd33b10d42 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.155731 May 12 17:50:13.349385 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 521/1046] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:13 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:13.636361 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-230639f9-834d-45d3-b267-a951166b47f7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:13.636937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-230639f9-834d-45d3-b267-a951166b47f7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:13.643462 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-230639f9-834d-45d3-b267-a951166b47f7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.643906 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-230639f9-834d-45d3-b267-a951166b47f7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.644668 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-230639f9-834d-45d3-b267-a951166b47f7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.645096 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-230639f9-834d-45d3-b267-a951166b47f7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.674853 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-230639f9-834d-45d3-b267-a951166b47f7 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/3ad1b587-0e66-46e6-96dc-ce39e1ed95fa" status: 200 len: 194 microversion: 2.1 time: 0.042805 May 12 17:50:13.675583 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 526/1047] 10.222.0.76 () {58 vars in 1412 bytes} [Thu May 12 17:50:13 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/3ad1b587-0e66-46e6-96dc-ce39e1ed95fa => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:13.685733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:13.686263 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:13.692391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.692843 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.693623 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.694069 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.708469 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-33083014-3cdd-4e0c-a858-28e59dc97483 req-cc78ab2d-fa23-4569-95f6-809c786e87e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94af4804-8a27-4f9b-b471-7fa1a1dabedf", "name": "network-vif-plugged", "status": "completed", "tag": "4903dc03-9110-43e6-bfaf-db2e0fe64355"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:13.718194 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-33083014-3cdd-4e0c-a858-28e59dc97483 req-cc78ab2d-fa23-4569-95f6-809c786e87e1 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.719186 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-33083014-3cdd-4e0c-a858-28e59dc97483 req-cc78ab2d-fa23-4569-95f6-809c786e87e1 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.732884 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-33083014-3cdd-4e0c-a858-28e59dc97483 req-cc78ab2d-fa23-4569-95f6-809c786e87e1 service nova] Creating event network-vif-plugged:4903dc03-9110-43e6-bfaf-db2e0fe64355 for instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf on hv-cinder-83979 May 12 17:50:13.737938 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-33083014-3cdd-4e0c-a858-28e59dc97483 req-cc78ab2d-fa23-4569-95f6-809c786e87e1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033204 May 12 17:50:13.738793 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 527/1048] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:13.780209 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lazy-loading 'services' on Instance uuid 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:50:13.859213 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-de53d319-a004-4b58-9c9b-3797358e72e0 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/3ad1b587-0e66-46e6-96dc-ce39e1ed95fa" status: 202 len: 0 microversion: 2.1 time: 0.177073 May 12 17:50:13.863070 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 522/1049] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:50:13 2022] DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments/3ad1b587-0e66-46e6-96dc-ce39e1ed95fa => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:50:14.365996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:14.366749 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:14.372947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:14.373462 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:14.374313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:14.374781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:14.516661 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:14.525679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b54be31d-1438-4297-8016-d4eeda0a687d tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.162571 May 12 17:50:14.526254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 528/1050] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:14 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:15.024756 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-da794917-4f1b-42f2-8764-510e44f2c48f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:15.025846 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-da794917-4f1b-42f2-8764-510e44f2c48f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:15.031938 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-da794917-4f1b-42f2-8764-510e44f2c48f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:15.032397 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-da794917-4f1b-42f2-8764-510e44f2c48f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:15.033168 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-da794917-4f1b-42f2-8764-510e44f2c48f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:15.033608 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-da794917-4f1b-42f2-8764-510e44f2c48f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:15.064439 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-da794917-4f1b-42f2-8764-510e44f2c48f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 May 12 17:50:15.065003 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 523/1051] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:50:15 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:15.543439 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:15.544030 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:15.550244 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:15.550709 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:15.551501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:15.551970 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:15.726121 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:15.734267 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-42943502-1a2c-4986-b8b2-42ca2b74cebe tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.195322 May 12 17:50:15.734855 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 529/1052] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:15 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:16.075939 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-cefd466a-9990-4d6e-b27d-66deb3403d26 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:16.076894 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-cefd466a-9990-4d6e-b27d-66deb3403d26 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:16.083951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cefd466a-9990-4d6e-b27d-66deb3403d26 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.084407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cefd466a-9990-4d6e-b27d-66deb3403d26 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.085219 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cefd466a-9990-4d6e-b27d-66deb3403d26 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.085665 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-cefd466a-9990-4d6e-b27d-66deb3403d26 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.118212 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-cefd466a-9990-4d6e-b27d-66deb3403d26 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046766 May 12 17:50:16.119161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 524/1053] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:50:16 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:50:16.233323 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ab7267bb-577b-4eb1-a03b-b626524f5ddc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:16.234369 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ab7267bb-577b-4eb1-a03b-b626524f5ddc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:16.241102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ab7267bb-577b-4eb1-a03b-b626524f5ddc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.241215 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ab7267bb-577b-4eb1-a03b-b626524f5ddc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.241996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ab7267bb-577b-4eb1-a03b-b626524f5ddc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.242436 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ab7267bb-577b-4eb1-a03b-b626524f5ddc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.270419 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ab7267bb-577b-4eb1-a03b-b626524f5ddc tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042723 May 12 17:50:16.271007 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 530/1054] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:50:16 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:50:16.329321 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:16.329813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:16.335723 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.336175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.336942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.337378 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.362386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:50:16.436336 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d0ac2a82-d932-40a8-af33-6fc4854ca1c9 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 204 len: 0 microversion: 2.1 time: 0.110638 May 12 17:50:16.436914 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 525/1055] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:50:16 2022] DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:50:16.445016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:16.445627 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:16.452352 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.452799 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.453568 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.454008 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.581523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:16.588910 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-aceb8576-4da9-41dc-ac8a-6a8fdc43ed06 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1675 microversion: 2.1 time: 0.147703 May 12 17:50:16.589455 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 531/1056] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:16 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:16.752554 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:16.753256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:16.759259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.759654 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.760678 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.761240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.894888 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:16.903151 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c608cf46-df26-4c12-98b7-100524b7783b tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.154863 May 12 17:50:16.903715 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 526/1057] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:16 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:17.606047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:17.606661 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:17.612989 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.613445 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:17.614215 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.614656 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:17.745122 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:17.752439 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3b1c284f-47bf-4208-a120-554ae06a64d8 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1675 microversion: 2.1 time: 0.150507 May 12 17:50:17.753002 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 532/1058] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:17 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:17.920982 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:17.921565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:17.927839 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.928280 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:17.929038 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.929476 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:18.056888 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:18.064292 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-22d0642b-391f-437a-8011-141ab3a73bde tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1574 microversion: 2.1 time: 0.148518 May 12 17:50:18.064841 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 527/1059] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:17 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:18.770136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:18.770800 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:18.779236 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:18.779699 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:18.780479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:18.781100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:18.912248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:18.919684 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8728be0d-d7f6-40bc-828f-dbd36f67d4e6 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1675 microversion: 2.1 time: 0.153902 May 12 17:50:18.920248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 533/1060] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:18 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:19.081402 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:19.082018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:19.089426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.089869 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.090643 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.091103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.219503 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:19.226758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9e067680-4279-4487-bada-efb88e3b5bfd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1561 microversion: 2.1 time: 0.149225 May 12 17:50:19.227329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 528/1061] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:19 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:19.936125 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:19.936761 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:19.943016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.943471 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.944237 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.944676 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.070990 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:20.078802 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5964b145-69e0-407f-9fee-9fbdafa16c7b tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1675 microversion: 2.1 time: 0.146658 May 12 17:50:20.079358 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 534/1062] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:19 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:21.096449 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:21.097062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:21.103410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:21.103865 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:21.104638 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:21.105077 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:21.485072 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:21.492733 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d097231e-0e45-430e-bf88-b1d24e0d9baf tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1675 microversion: 2.1 time: 0.400053 May 12 17:50:21.493235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 529/1063] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:21 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1675 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:22.511997 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:22.513473 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:22.520751 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.521500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.522629 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.523176 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.527353 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-f41f191d-1758-4f8a-a15c-a442f07bd8bc req-f9d68951-e012-42bb-a451-1852d62b10f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9b5fa5-bcf2-4da6-b13c-85aeee61a134", "name": "network-vif-deleted", "tag": "57cd4c81-8280-4d5e-b1ca-0c2c662e6d98"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:22.537610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f41f191d-1758-4f8a-a15c-a442f07bd8bc req-f9d68951-e012-42bb-a451-1852d62b10f2 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.538062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f41f191d-1758-4f8a-a15c-a442f07bd8bc req-f9d68951-e012-42bb-a451-1852d62b10f2 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.552239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-f41f191d-1758-4f8a-a15c-a442f07bd8bc req-f9d68951-e012-42bb-a451-1852d62b10f2 service nova] Creating event network-vif-deleted:57cd4c81-8280-4d5e-b1ca-0c2c662e6d98 for instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 on hv-cinder-83979 May 12 17:50:22.557772 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-f41f191d-1758-4f8a-a15c-a442f07bd8bc req-f9d68951-e012-42bb-a451-1852d62b10f2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034167 May 12 17:50:22.559810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 530/1064] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:22.597418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8866c723166455a9711559eb7f125c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf607837a27e47bf99a32b3b095df070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:22.606343 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-046060c8-bf2d-4e22-bc99-717c4328796e tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 200 len: 1608 microversion: 2.1 time: 0.097723 May 12 17:50:22.607304 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 535/1065] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:22 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 1608 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:23.624633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:23.625364 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:23.631714 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:23.632168 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:23.633109 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:23.633810 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:23.647543 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] HTTP exception thrown: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Request method failure captured: May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 HTTP/1.1 May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcbOAvocbyxh19Uf1MsLEvq6GyynAVphigXsygy3FqJyYC3X_ERgDXwsqQcznpwPLyJQyC9qLznzJ98iVl6sooHDBmRAu-H6oGJlCnt5_rjHftRs8hj1-EN25ZlVyJt06fTFzGqk8bkTDe8kQFs_L7CJuhQ_jA6wAvVFut2OLaHaMg May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:50:23.649512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bf607837a27e47bf99a32b3b095df070", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: d8866c723166455a9711559eb7f125c4 May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:23.651312 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '3f9b5fa5-bcf2-4da6-b13c-85aeee61a134'} May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:23.652205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:23.654350 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:23.656078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Returning 404 to user: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:23.656078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ef323267-0981-4b71-a6c7-5ca0f6d36019 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 404 len: 111 microversion: 2.1 time: 0.031104 May 12 17:50:23.656078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 531/1066] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:23 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:23.661262 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-905050ef-288d-4f6f-a4e2-9aa6efcb43ea tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '.version_select at 0x7f24bc16f940>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:23.679996 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-905050ef-288d-4f6f-a4e2-9aa6efcb43ea tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359779797" status: 202 len: 0 microversion: 2.1 time: 0.022913 May 12 17:50:23.680662 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 536/1067] 10.222.0.76 () {58 vars in 1220 bytes} [Thu May 12 17:50:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359779797 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:50:24.206299 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1170927378", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235511178", "security_groups": [{"name": "tempest-secgroup-smoke-1268337681"}], "block_device_mapping_v2": [{"uuid": "40e6d21c-9f46-4940-beed-0ef9ea14d3cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb76e15-efb3-4276-8531-f3adac3a6ec1"}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:24.341907 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] validate_networks() for [('3cb76e15-efb3-4276-8531-f3adac3a6ec1', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:50:24.734159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:50:24.734795 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:50:24.735262 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:50:24.735677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:50:24.736093 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:50:24.745022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:24.745555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:24.746603 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:24.747151 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:24.764446 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:50:24.769004 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Getting quotas for user 7802c329d4ca4eccb28fdec9f8082cc1 and project 4e9154d1a4c44c6b8a42001c659d069b. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:50:24.835812 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:50:24.837895 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40e6d21c-9f46-4940-beed-0ef9ea14d3cb',volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:50:24.964264 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-630972e5-72ae-4f46-9290-e64405f64d43 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762967 May 12 17:50:24.964902 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 532/1068] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:50:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:50:24.976001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-24807fd6-6b4e-40d1-b49d-9d7ac960c510 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:24.976613 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-24807fd6-6b4e-40d1-b49d-9d7ac960c510 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:25.031671 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-24807fd6-6b4e-40d1-b49d-9d7ac960c510 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:25.038256 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-24807fd6-6b4e-40d1-b49d-9d7ac960c510 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1094 microversion: 2.1 time: 0.066309 May 12 17:50:25.038832 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 537/1069] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:24 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:26.057369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:26.058399 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:26.067525 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.068113 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.069146 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.069652 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.175372 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:26.185578 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-dd046d17-c7a7-4678-9e4a-c2c8fc5883a0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1210 microversion: 2.1 time: 0.133617 May 12 17:50:26.186619 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 533/1070] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:26 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:26.597488 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:26.598104 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:26.604753 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.605298 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.607087 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.607755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.626503 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] HTTP exception thrown: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Request method failure captured: May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 HTTP/1.1 May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcbOAvocbyxh19Uf1MsLEvq6GyynAVphigXsygy3FqJyYC3X_ERgDXwsqQcznpwPLyJQyC9qLznzJ98iVl6sooHDBmRAu-H6oGJlCnt5_rjHftRs8hj1-EN25ZlVyJt06fTFzGqk8bkTDe8kQFs_L7CJuhQ_jA6wAvVFut2OLaHaMg May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:50:26.628465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bf607837a27e47bf99a32b3b095df070", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: d8866c723166455a9711559eb7f125c4 May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.630254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '3f9b5fa5-bcf2-4da6-b13c-85aeee61a134'} May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:26.631242 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.633020 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:26.635957 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Returning 404 to user: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:26.637958 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ed7478ed-3b53-4379-8086-fa7ef9242b85 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 404 len: 111 microversion: 2.1 time: 0.043700 May 12 17:50:26.639017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 538/1071] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:50:26 2022] DELETE /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:50:26.647161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:26.647696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:26.654304 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.655023 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.655997 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.656433 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.673639 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] HTTP exception thrown: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Request method failure captured: May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 HTTP/1.1 May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcbOAvocbyxh19Uf1MsLEvq6GyynAVphigXsygy3FqJyYC3X_ERgDXwsqQcznpwPLyJQyC9qLznzJ98iVl6sooHDBmRAu-H6oGJlCnt5_rjHftRs8hj1-EN25ZlVyJt06fTFzGqk8bkTDe8kQFs_L7CJuhQ_jA6wAvVFut2OLaHaMg May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:50:26.675602 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bf607837a27e47bf99a32b3b095df070", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: d8866c723166455a9711559eb7f125c4 May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.677284 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '3f9b5fa5-bcf2-4da6-b13c-85aeee61a134'} May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:26.678363 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. May 12 17:50:26.684591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:26.686092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Returning 404 to user: Instance 3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:26.686092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-356b13de-c850-486e-a1e1-9056edc2d1a1 tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134" status: 404 len: 111 microversion: 2.1 time: 0.033968 May 12 17:50:26.686092 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 534/1072] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:26 2022] GET /compute/v2.1/servers/3f9b5fa5-bcf2-4da6-b13c-85aeee61a134 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:27.202950 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:27.203830 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:27.210116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.210572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.211391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.212041 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.386076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:27.397338 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c42f018c-37b4-44aa-8a93-689499c7c954 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.198717 May 12 17:50:27.408004 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 539/1073] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:27 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:27.572083 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-a103eb33-d86d-4762-8a3a-07eccb1e6c0d req-00564d9e-9b4a-4f01-9579-63c2cf14f5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050e8718-e2ab-4e72-b674-2dee39306e04", "tag": "9080bbb4-c021-4c41-9e20-56892559bb65"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:27.582535 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a103eb33-d86d-4762-8a3a-07eccb1e6c0d req-00564d9e-9b4a-4f01-9579-63c2cf14f5b8 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.583031 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-a103eb33-d86d-4762-8a3a-07eccb1e6c0d req-00564d9e-9b4a-4f01-9579-63c2cf14f5b8 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.595245 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-a103eb33-d86d-4762-8a3a-07eccb1e6c0d req-00564d9e-9b4a-4f01-9579-63c2cf14f5b8 service nova] Creating event network-changed:9080bbb4-c021-4c41-9e20-56892559bb65 for instance 050e8718-e2ab-4e72-b674-2dee39306e04 on hv-cinder-83979 May 12 17:50:27.610832 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-a103eb33-d86d-4762-8a3a-07eccb1e6c0d req-00564d9e-9b4a-4f01-9579-63c2cf14f5b8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033134 May 12 17:50:27.612083 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 535/1074] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:27.861486 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:27.862106 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:27.868839 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.869763 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.870337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.870898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.885598 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] HTTP exception thrown: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Request method failure captured: May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b HTTP/1.1 May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcbOAvocbyxh19Uf1MsLEvq6GyynAVphigXsygy3FqJyYC3X_ERgDXwsqQcznpwPLyJQyC9qLznzJ98iVl6sooHDBmRAu-H6oGJlCnt5_rjHftRs8hj1-EN25ZlVyJt06fTFzGqk8bkTDe8kQFs_L7CJuhQ_jA6wAvVFut2OLaHaMg May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:50:27.888328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bf607837a27e47bf99a32b3b095df070", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: d8866c723166455a9711559eb7f125c4 May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.889980 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': 'a92a89c3-a796-4a8b-9491-3f944bca5a9b'} May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:27.890923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.892379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:27.893860 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Returning 404 to user: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:27.894501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-229b8008-05d5-406e-ae0e-6c713a6dc43c tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 404 len: 111 microversion: 2.1 time: 0.036940 May 12 17:50:27.895351 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 540/1075] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:50:27 2022] DELETE /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:50:27.908613 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:27.909789 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] [instance: a92a89c3-a796-4a8b-9491-3f944bca5a9b] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:27.920992 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.921829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.923255 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.924066 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.945592 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] HTTP exception thrown: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Request method failure captured: May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b HTTP/1.1 May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcbOAvocbyxh19Uf1MsLEvq6GyynAVphigXsygy3FqJyYC3X_ERgDXwsqQcznpwPLyJQyC9qLznzJ98iVl6sooHDBmRAu-H6oGJlCnt5_rjHftRs8hj1-EN25ZlVyJt06fTFzGqk8bkTDe8kQFs_L7CJuhQ_jA6wAvVFut2OLaHaMg May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:50:27.947302 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bf607837a27e47bf99a32b3b095df070", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bf607837a27e47bf99a32b3b095df070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: bf607837a27e47bf99a32b3b095df070 May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1657542953 May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: d8866c723166455a9711559eb7f125c4 May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeTestJSON-1657542953-project May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.948967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'a92a89c3-a796-4a8b-9491-3f944bca5a9b'} May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:27.954362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. May 12 17:50:27.956375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:27.957806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] Returning 404 to user: Instance a92a89c3-a796-4a8b-9491-3f944bca5a9b could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:27.957806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-57b701a0-596f-4e5a-b9c1-36278eedbc7f tempest-AttachVolumeTestJSON-1657542953 tempest-AttachVolumeTestJSON-1657542953-project] 10.222.0.76 "GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b" status: 404 len: 111 microversion: 2.1 time: 0.048514 May 12 17:50:27.957806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 536/1076] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:27 2022] GET /compute/v2.1/servers/a92a89c3-a796-4a8b-9491-3f944bca5a9b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:50:28.416105 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:28.417010 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:28.423489 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:28.424183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:28.424972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:28.425411 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:28.564924 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:28.573903 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-80ed031b-78c8-422f-a7a3-5db622d19b24 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.161845 May 12 17:50:28.574909 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 541/1077] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:28 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:29.591801 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:29.592382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:29.602945 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:29.603647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:29.605089 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:29.605735 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:29.841868 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:29.849550 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-28c7d04b-172e-47b4-8dcd-3d1f27e4fe7a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.262149 May 12 17:50:29.850125 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 537/1078] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:29 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:30.867075 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:30.867786 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:30.875434 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.876003 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:30.876969 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.877516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:31.014657 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:31.022115 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-4d17ad6d-6f75-4a84-b75e-ad368f3465c0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.158943 May 12 17:50:31.022698 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 542/1079] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:30 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:32.040267 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:32.040921 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:32.047738 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:32.048305 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:32.048958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:32.049402 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:32.207429 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:32.215871 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9b4dae11-dd33-4776-9e77-422c55ad1a0d tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.179357 May 12 17:50:32.216442 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 538/1080] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:32 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:33.239947 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:33.246824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:33.253263 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:33.253716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:33.254525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:33.255005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:33.399510 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:33.409719 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-b1b03dd8-6c0e-43a0-8019-eb9c510e02bb tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.180908 May 12 17:50:33.410302 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 543/1081] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:33 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:34.427736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:34.428531 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:34.437916 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.441012 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.442036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.442798 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.632352 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:34.640957 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-bf3fc290-d8f3-45a2-84fb-0dd7a086f029 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.217237 May 12 17:50:34.642036 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 539/1082] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:34 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:35.658919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:35.659486 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:35.665452 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.666303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.666701 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.667137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.833145 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:35.845074 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5b13cb89-516b-4b94-b904-52e3807f923b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.189660 May 12 17:50:35.846046 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 544/1083] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:35 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:36.552835 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1c099ddb-8cb0-485d-8725-e86710acd8c3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:36.553844 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1c099ddb-8cb0-485d-8725-e86710acd8c3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:36.560813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c099ddb-8cb0-485d-8725-e86710acd8c3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.561267 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c099ddb-8cb0-485d-8725-e86710acd8c3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.562107 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c099ddb-8cb0-485d-8725-e86710acd8c3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.562742 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c099ddb-8cb0-485d-8725-e86710acd8c3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.595333 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1c099ddb-8cb0-485d-8725-e86710acd8c3 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046308 May 12 17:50:36.596473 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 540/1084] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 12 17:50:36 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:36.662290 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:36.663416 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:36.670464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.670948 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.671740 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.672232 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.698510 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:50:36.781826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-74a07981-3e56-46cc-9167-27b88f896d33 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 204 len: 0 microversion: 2.20 time: 0.122864 May 12 17:50:36.782519 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 545/1085] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 12 17:50:36 2022] DELETE /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:50:36.791205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:36.791838 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:36.801818 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.802273 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.803266 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.803688 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.863125 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:36.863826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:36.870182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.872136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.873804 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.874907 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.966627 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:36.975509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:36.977100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:36.978694 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-93984c3b-c477-42bd-af43-ebb0a43e6e4b tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.191630 May 12 17:50:36.979724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 541/1086] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:50:36 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:37.038162 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:37.047287 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-429e6db1-66e4-4fed-b844-44ccbb9b5791 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.188303 May 12 17:50:37.057011 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 546/1087] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:36 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:37.810104 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-59f06885-bdd8-499d-a9a4-6ccce131ac1e req-049cb134-38eb-4428-9219-4c8a6ae5664a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050e8718-e2ab-4e72-b674-2dee39306e04", "name": "network-vif-plugged", "status": "completed", "tag": "9080bbb4-c021-4c41-9e20-56892559bb65"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:37.824408 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-59f06885-bdd8-499d-a9a4-6ccce131ac1e req-049cb134-38eb-4428-9219-4c8a6ae5664a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:37.828815 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-59f06885-bdd8-499d-a9a4-6ccce131ac1e req-049cb134-38eb-4428-9219-4c8a6ae5664a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:37.868789 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-59f06885-bdd8-499d-a9a4-6ccce131ac1e req-049cb134-38eb-4428-9219-4c8a6ae5664a service nova] Creating event network-vif-plugged:9080bbb4-c021-4c41-9e20-56892559bb65 for instance 050e8718-e2ab-4e72-b674-2dee39306e04 on hv-cinder-83979 May 12 17:50:37.880898 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-59f06885-bdd8-499d-a9a4-6ccce131ac1e req-049cb134-38eb-4428-9219-4c8a6ae5664a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075583 May 12 17:50:37.883201 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 542/1088] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:38.000111 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:38.002206 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:38.009959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.010420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:38.012859 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.014203 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:38.065359 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:38.066063 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:38.072828 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.077253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:38.078361 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.078529 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:38.215821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:38.225254 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:38.226825 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:38.227991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3d9c81de-8b3f-4394-b48a-72d0f87e8234 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1724 microversion: 2.20 time: 0.233270 May 12 17:50:38.228540 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 547/1089] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:50:37 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:38.278883 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:38.288221 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9675e18a-3f1a-44d0-87e7-800eb589be2a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.227606 May 12 17:50:38.293221 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 543/1090] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:38 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:39.247755 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:39.248357 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:39.267039 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.267491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.268465 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.268900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.310556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:39.311455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:39.317958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.318407 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.319198 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.319632 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.345148 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.353310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.354848 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.356182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fbc71a2a-1313-4c10-897d-9fc629f26713 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1656 microversion: 2.20 time: 0.113478 May 12 17:50:39.363439 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 548/1091] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:50:39 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1656 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:39.453517 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.460896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-8e4e415e-49fc-41e1-a56f-a5fb09bf408e tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1266 microversion: 2.1 time: 0.155485 May 12 17:50:39.461465 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 544/1092] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:39 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:39.565575 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-2c96d26d-91d9-47b3-9327-89ebf6d5813f req-1fd06649-2498-4096-8432-8a014603aecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67972c22-858c-41e6-85f9-27327673af00", "name": "network-vif-deleted", "tag": "143d4171-1885-4746-8f1e-a6334c3f41fe"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:39.573644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-2c96d26d-91d9-47b3-9327-89ebf6d5813f req-1fd06649-2498-4096-8432-8a014603aecd service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.574240 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-2c96d26d-91d9-47b3-9327-89ebf6d5813f req-1fd06649-2498-4096-8432-8a014603aecd service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.585631 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-2c96d26d-91d9-47b3-9327-89ebf6d5813f req-1fd06649-2498-4096-8432-8a014603aecd service nova] Creating event network-vif-deleted:143d4171-1885-4746-8f1e-a6334c3f41fe for instance 67972c22-858c-41e6-85f9-27327673af00 on hv-cinder-83979 May 12 17:50:39.591500 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-2c96d26d-91d9-47b3-9327-89ebf6d5813f req-1fd06649-2498-4096-8432-8a014603aecd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029699 May 12 17:50:39.592100 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 549/1093] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:40.375100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:40.376794 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:40.384474 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.385017 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.385870 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.386996 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.434509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.435774 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.436402 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lazy-loading 'fault' on Instance uuid 67972c22-858c-41e6-85f9-27327673af00 {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:50:40.482057 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:40.488501 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:40.495211 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.495666 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.496484 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.497050 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.505146 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.517487 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.519970 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10626535b6874ef58b63d259f059cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07bc791aa8d45d4a9e72758f39f6a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.522126 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-08d7f2f0-b42f-4328-b503-5c387a7115f5 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 200 len: 1371 microversion: 2.20 time: 0.151751 May 12 17:50:40.524382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 545/1094] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:50:40 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:40.694560 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.704615 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-8e7f69e6-5ff1-43fd-b4ad-8b88e9cba1b3 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1454 microversion: 2.1 time: 0.229152 May 12 17:50:40.707105 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 550/1095] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:40 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1454 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:40.723253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:40.724942 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:40.739781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.740248 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.742366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.742366 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.904935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.913315 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d88367d9-7567-41c5-9ec3-a9d42d010c48 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1454 microversion: 2.1 time: 0.194815 May 12 17:50:40.913890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 546/1096] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:50:40 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:41.544350 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:41.544958 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:41.551743 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:41.552374 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:41.553228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:41.553801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:41.568228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] HTTP exception thrown: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Request method failure captured: May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 HTTP/1.1 May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcZEndFWEd9sShVIO4-TR8jAlRApCUpwETZjIsbY8NGpukpHYXXYkzFUAcy_SchTmRAHDN_Kt_cAYyFUp238tp7w6uJP-vZMonIq0jjAY0ob-XxZEEyBdKqnFGmtX74RjDbnLstyij5JmQJTrcl3WDm-4jf30s-4S6RoT-eam5e_tU May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:50:41.570013 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07bc791aa8d45d4a9e72758f39f6a85", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 10626535b6874ef58b63d259f059cd15 May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:41.571934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '67972c22-858c-41e6-85f9-27327673af00'} May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:41.572937 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:41.574427 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:41.576378 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Returning 404 to user: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:41.576378 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0a207ef1-9895-4183-bf56-d0d58b4480d8 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 404 len: 111 microversion: 2.20 time: 0.033567 May 12 17:50:41.576378 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 551/1097] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:50:41 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:50:41.581556 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e082c3c4-585f-4a5d-a0b2-f5b997f92e3e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '.version_select at 0x7f24bc29e3a0>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:41.600760 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e082c3c4-585f-4a5d-a0b2-f5b997f92e3e tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509714541" status: 204 len: 0 microversion: 2.20 time: 0.023069 May 12 17:50:41.601706 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 547/1098] 10.222.0.76 () {60 vars in 1258 bytes} [Thu May 12 17:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509714541 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:50:43.432090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-d9cab3fb-3c77-4a19-b1f8-9a2d3beec8cd req-2ef0e629-3ea2-4059-ac78-d77d48d5e502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050e8718-e2ab-4e72-b674-2dee39306e04", "tag": "9080bbb4-c021-4c41-9e20-56892559bb65"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:43.453864 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d9cab3fb-3c77-4a19-b1f8-9a2d3beec8cd req-2ef0e629-3ea2-4059-ac78-d77d48d5e502 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:43.454808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-d9cab3fb-3c77-4a19-b1f8-9a2d3beec8cd req-2ef0e629-3ea2-4059-ac78-d77d48d5e502 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:43.472255 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-d9cab3fb-3c77-4a19-b1f8-9a2d3beec8cd req-2ef0e629-3ea2-4059-ac78-d77d48d5e502 service nova] Creating event network-changed:9080bbb4-c021-4c41-9e20-56892559bb65 for instance 050e8718-e2ab-4e72-b674-2dee39306e04 on hv-cinder-83979 May 12 17:50:43.478327 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-d9cab3fb-3c77-4a19-b1f8-9a2d3beec8cd req-2ef0e629-3ea2-4059-ac78-d77d48d5e502 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051614 May 12 17:50:43.479660 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 552/1099] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:43.671645 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:43.672641 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:43.687127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:43.688916 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:43.691990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:43.692771 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:43.724048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] HTTP exception thrown: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Request method failure captured: May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: DELETE /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 HTTP/1.1 May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcZEndFWEd9sShVIO4-TR8jAlRApCUpwETZjIsbY8NGpukpHYXXYkzFUAcy_SchTmRAHDN_Kt_cAYyFUp238tp7w6uJP-vZMonIq0jjAY0ob-XxZEEyBdKqnFGmtX74RjDbnLstyij5JmQJTrcl3WDm-4jf30s-4S6RoT-eam5e_tU May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:50:43.725662 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07bc791aa8d45d4a9e72758f39f6a85", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 10626535b6874ef58b63d259f059cd15 May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.727524 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '67972c22-858c-41e6-85f9-27327673af00'} May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:43.728405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.730509 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:43.732344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Returning 404 to user: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:43.732344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a1f49667-753e-473c-ac40-4db71b9ca282 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 404 len: 111 microversion: 2.20 time: 0.060941 May 12 17:50:43.732344 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 548/1100] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 12 17:50:43 2022] DELETE /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:50:43.741332 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:43.744806 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 67972c22-858c-41e6-85f9-27327673af00] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:43.754259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:43.755490 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:43.756826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:43.757557 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:43.778314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] HTTP exception thrown: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Request method failure captured: May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 HTTP/1.1 May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcZEndFWEd9sShVIO4-TR8jAlRApCUpwETZjIsbY8NGpukpHYXXYkzFUAcy_SchTmRAHDN_Kt_cAYyFUp238tp7w6uJP-vZMonIq0jjAY0ob-XxZEEyBdKqnFGmtX74RjDbnLstyij5JmQJTrcl3WDm-4jf30s-4S6RoT-eam5e_tU May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:50:43.780822 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07bc791aa8d45d4a9e72758f39f6a85", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 10626535b6874ef58b63d259f059cd15 May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.782526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '67972c22-858c-41e6-85f9-27327673af00'} May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:43.786502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. May 12 17:50:43.788200 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:43.789538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Returning 404 to user: Instance 67972c22-858c-41e6-85f9-27327673af00 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:43.789538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5bd6d82c-39b2-4316-b140-e14e5bfb3f05 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00" status: 404 len: 111 microversion: 2.20 time: 0.049165 May 12 17:50:43.789538 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 553/1101] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:50:43 2022] GET /compute/v2.1/servers/67972c22-858c-41e6-85f9-27327673af00 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:50:44.981757 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:44.982383 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:44.989180 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:44.989787 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:44.990646 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:44.991130 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:45.005304 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] HTTP exception thrown: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Request method failure captured: May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: DELETE /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 HTTP/1.1 May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUcZEndFWEd9sShVIO4-TR8jAlRApCUpwETZjIsbY8NGpukpHYXXYkzFUAcy_SchTmRAHDN_Kt_cAYyFUp238tp7w6uJP-vZMonIq0jjAY0ob-XxZEEyBdKqnFGmtX74RjDbnLstyij5JmQJTrcl3WDm-4jf30s-4S6RoT-eam5e_tU May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:50:45.006896 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07bc791aa8d45d4a9e72758f39f6a85", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 10626535b6874ef58b63d259f059cd15 May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.008581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '12b3f033-5f36-4355-8221-ab55bcba8722'} May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:45.011501 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.013055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:50:45.014566 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Returning 404 to user: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:45.014566 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-6129591a-3526-48f8-9909-b2b04717a1ec tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "DELETE /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 404 len: 111 microversion: 2.20 time: 0.031505 May 12 17:50:45.014566 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 549/1102] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 12 17:50:44 2022] DELETE /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:50:45.016883 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:45.017478 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] [instance: 12b3f033-5f36-4355-8221-ab55bcba8722] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:45.023723 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:45.024437 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:45.025203 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:45.025634 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:45.044883 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] HTTP exception thrown: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Request method failure captured: May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 HTTP/1.1 May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUcZEndFWEd9sShVIO4-TR8jAlRApCUpwETZjIsbY8NGpukpHYXXYkzFUAcy_SchTmRAHDN_Kt_cAYyFUp238tp7w6uJP-vZMonIq0jjAY0ob-XxZEEyBdKqnFGmtX74RjDbnLstyij5JmQJTrcl3WDm-4jf30s-4S6RoT-eam5e_tU May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:50:45.046418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07bc791aa8d45d4a9e72758f39f6a85", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07bc791aa8d45d4a9e72758f39f6a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: c07bc791aa8d45d4a9e72758f39f6a85 May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139429004 May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 10626535b6874ef58b63d259f059cd15 May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139429004-project May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.048112 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '12b3f033-5f36-4355-8221-ab55bcba8722'} May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:45.049120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. May 12 17:50:45.050554 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:50:45.052017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] Returning 404 to user: Instance 12b3f033-5f36-4355-8221-ab55bcba8722 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:45.052017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a9ea7f3a-0f60-4fa9-af60-b3e2f3af6919 tempest-AttachVolumeShelveTestJSON-2139429004 tempest-AttachVolumeShelveTestJSON-2139429004-project] 10.222.0.76 "GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722" status: 404 len: 111 microversion: 2.20 time: 0.034734 May 12 17:50:45.052017 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 554/1103] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 12 17:50:45 2022] GET /compute/v2.1/servers/12b3f033-5f36-4355-8221-ab55bcba8722 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:51:00.545166 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-591767104", "imageRef": "89c4c9e8-30e7-472f-af2b-fd005c2c2b2d", "flavorRef": "452"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:00.598526 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] validate_networks() for None {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:51:00.874785 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:51:00.875239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:51:00.875718 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:51:00.876137 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:51:00.876555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:51:00.885948 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:00.886518 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:00.887462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:00.887910 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:00.904758 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Getting quotas for project 33191abe2493419b91a6c40da029f81e. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:51:00.908811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Getting quotas for user d14a81fc4dda425ebf8d48fdbf174839 and project 33191abe2493419b91a6c40da029f81e. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:51:00.921435 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:51:00.923743 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c4c9e8-30e7-472f-af2b-fd005c2c2b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:51:00.974120 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c53bf8ea-2489-4dc0-a7f1-aede0c182b91 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.433734 May 12 17:51:00.974921 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 550/1104] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:51:00.987057 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-9550c9cd-12d5-4b7f-9ff1-855cf8569609 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:00.988056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-9550c9cd-12d5-4b7f-9ff1-855cf8569609 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:01.061477 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-9550c9cd-12d5-4b7f-9ff1-855cf8569609 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:01.070484 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-9550c9cd-12d5-4b7f-9ff1-855cf8569609 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1214 microversion: 2.1 time: 0.088622 May 12 17:51:01.072579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 555/1105] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:00 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:02.090327 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:02.091233 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:02.098300 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:02.099060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:02.099859 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:02.100306 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:02.180165 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:02.195240 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-97967cc1-537c-4d4b-9a91-0f0b8eeefe0c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1274 microversion: 2.1 time: 0.109493 May 12 17:51:02.195819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 551/1106] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:02 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:03.213383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:03.215516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:03.233153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:03.234824 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:03.236592 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:03.237187 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:03.476349 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:03.497812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-eae9638d-1263-491c-81b0-663faa073730 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.286747 May 12 17:51:03.498983 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 556/1107] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:03 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:03.848990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-f1746346-4e41-48d3-9078-9ca1ab9e080b req-8465c192-c907-438c-b14e-8792bec4b777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6d9750-3969-4d0e-8973-3690ea41849e", "tag": "527b56b8-4df4-48a7-864e-0f0b87a2f817"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:03.863490 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f1746346-4e41-48d3-9078-9ca1ab9e080b req-8465c192-c907-438c-b14e-8792bec4b777 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:03.864187 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f1746346-4e41-48d3-9078-9ca1ab9e080b req-8465c192-c907-438c-b14e-8792bec4b777 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:03.884901 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-f1746346-4e41-48d3-9078-9ca1ab9e080b req-8465c192-c907-438c-b14e-8792bec4b777 service nova] Creating event network-changed:527b56b8-4df4-48a7-864e-0f0b87a2f817 for instance 7c6d9750-3969-4d0e-8973-3690ea41849e on hv-cinder-83979 May 12 17:51:03.895761 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-f1746346-4e41-48d3-9078-9ca1ab9e080b req-8465c192-c907-438c-b14e-8792bec4b777 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050590 May 12 17:51:03.897005 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 552/1108] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:04.515456 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:04.516156 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:04.522972 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:04.523426 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:04.524461 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:04.525523 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:04.693457 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:04.700919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2fa8c924-fd85-4c44-a3d2-f4ce1b5d609a tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.189474 May 12 17:51:04.701487 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 557/1109] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:04 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:51:05.721819 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:05.722533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:05.746951 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:05.748473 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:05.750477 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:05.751386 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:05.900764 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:05.909162 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-11834d86-700e-400a-8daa-543d9f78e37c tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.191497 May 12 17:51:05.909726 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 553/1110] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:05 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:06.927049 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:06.927739 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:06.934031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:06.934568 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:06.939416 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:06.939877 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:07.084150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:07.093672 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2c237601-7258-40f2-8269-f871d76e1127 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.170904 May 12 17:51:07.094563 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 558/1111] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:06 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:08.110786 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:08.111519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:08.118189 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:08.118771 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:08.119619 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:08.120164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:08.271962 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:08.283080 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b7d7c08f-bed7-4824-bf8e-ff354912b949 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.176202 May 12 17:51:08.283851 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 554/1112] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:08 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:09.300540 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:09.301439 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:09.308579 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:09.308974 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:09.309751 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:09.310192 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:09.459524 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:09.469196 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fff7332e-ecc0-4d82-9713-681e84ca03a5 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.172453 May 12 17:51:09.469768 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 559/1113] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:09 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:10.335630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-acc9c2db-ce57-4895-8e7c-e0cef3249928 req-9fca94f2-0701-4edf-9a8d-59f17559d668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6d9750-3969-4d0e-8973-3690ea41849e", "name": "network-vif-plugged", "status": "completed", "tag": "527b56b8-4df4-48a7-864e-0f0b87a2f817"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:10.344777 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-acc9c2db-ce57-4895-8e7c-e0cef3249928 req-9fca94f2-0701-4edf-9a8d-59f17559d668 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:10.345241 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-acc9c2db-ce57-4895-8e7c-e0cef3249928 req-9fca94f2-0701-4edf-9a8d-59f17559d668 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:10.356722 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-acc9c2db-ce57-4895-8e7c-e0cef3249928 req-9fca94f2-0701-4edf-9a8d-59f17559d668 service nova] Creating event network-vif-plugged:527b56b8-4df4-48a7-864e-0f0b87a2f817 for instance 7c6d9750-3969-4d0e-8973-3690ea41849e on hv-cinder-83979 May 12 17:51:10.361484 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-acc9c2db-ce57-4895-8e7c-e0cef3249928 req-9fca94f2-0701-4edf-9a8d-59f17559d668 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029702 May 12 17:51:10.362226 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 555/1114] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:10.486210 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:10.486867 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:10.493315 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:10.493774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:10.494558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:10.495128 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:10.678128 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:10.686064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-63cbe066-0184-4191-a3cc-bfea44ae90df tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.203863 May 12 17:51:10.686630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 560/1115] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:10 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:11.704853 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:11.705552 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:11.713356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:11.713356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:11.713356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:11.713356 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:11.845080 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:11.852332 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-3b0f8599-0feb-4b39-b6bf-13b7073146e0 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1314 microversion: 2.1 time: 0.152237 May 12 17:51:11.852904 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 556/1116] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:11 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:12.869509 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:12.870757 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:12.877154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:12.877605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:12.878372 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:12.878846 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:13.020942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:13.029259 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e5b5535c-bdac-4155-b8f2-287cb5951146 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1463 microversion: 2.1 time: 0.163552 May 12 17:51:13.029808 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 561/1117] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:12 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:13.066823 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:13.067330 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:13.073854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:13.074304 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:13.075087 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:13.075519 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:13.100499 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:51:13.176791 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b151b56b-56ad-4a45-81a3-eb0f19e989cd tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 204 len: 0 microversion: 2.1 time: 0.113451 May 12 17:51:13.177295 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 557/1118] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:51:13 2022] DELETE /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:51:13.186391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:13.187054 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:13.192986 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:13.193436 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:13.194207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:13.194643 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:13.327055 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:13.334516 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e505f3ea-6bdf-4b5e-ab06-5a30c08c61e6 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1469 microversion: 2.1 time: 0.152627 May 12 17:51:13.335183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 562/1119] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:13 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:51:14.353333 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:14.354023 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:14.360409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:14.360858 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:14.361619 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:14.362055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:14.491681 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:14.499499 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-681164f9-2226-4460-95d7-39e6f80ac9d3 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1469 microversion: 2.1 time: 0.150358 May 12 17:51:14.500057 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 558/1120] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:14 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:15.491666 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-bd276f85-7b5c-408c-b8ff-a3d930b4032b req-419f0cd6-fe08-4a25-9454-8a1623fc9842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6d9750-3969-4d0e-8973-3690ea41849e", "name": "network-vif-deleted", "tag": "527b56b8-4df4-48a7-864e-0f0b87a2f817"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:15.502395 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-bd276f85-7b5c-408c-b8ff-a3d930b4032b req-419f0cd6-fe08-4a25-9454-8a1623fc9842 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:15.502878 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-bd276f85-7b5c-408c-b8ff-a3d930b4032b req-419f0cd6-fe08-4a25-9454-8a1623fc9842 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:15.517856 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:15.518497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:15.528912 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:15.529382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:15.530210 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:15.530704 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:15.533682 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-bd276f85-7b5c-408c-b8ff-a3d930b4032b req-419f0cd6-fe08-4a25-9454-8a1623fc9842 service nova] Creating event network-vif-deleted:527b56b8-4df4-48a7-864e-0f0b87a2f817 for instance 7c6d9750-3969-4d0e-8973-3690ea41849e on hv-cinder-83979 May 12 17:51:15.538826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-bd276f85-7b5c-408c-b8ff-a3d930b4032b req-419f0cd6-fe08-4a25-9454-8a1623fc9842 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051315 May 12 17:51:15.540207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 563/1121] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:15.602591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14a81fc4dda425ebf8d48fdbf174839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33191abe2493419b91a6c40da029f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:15.611834 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-dc3c702f-0a3b-4d56-a3f4-411585e74530 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 200 len: 1299 microversion: 2.1 time: 0.098646 May 12 17:51:15.612426 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 559/1122] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:15 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:16.630430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:16.631163 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] [instance: 7c6d9750-3969-4d0e-8973-3690ea41849e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:16.637870 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:16.638305 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:16.639108 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:16.639545 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:16.653143 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] HTTP exception thrown: Instance 7c6d9750-3969-4d0e-8973-3690ea41849e could not be found. May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Request method failure captured: May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e HTTP/1.1 May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUkCN4A0hvzgcn3q--im7gVFYXMp0Qsuw-3JyPT_WgwB-ZImDqYWIKU3szvdCvygyZtvBdhKT_42Af3CcbnO6dxaLe-7PvYNtQazsx0l7D60VA5DDsWtv7Wjj0_DdmNBLgJsUVw0s-JgGjXXzwtMGyExASWucRnxXUHCGO-JV1fS0hk May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 33191abe2493419b91a6c40da029f81e May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-VolumesNegativeTest-1349531646 May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:51:16.654796 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/33191abe2493419b91a6c40da029f81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_33191abe2493419b91a6c40da029f81e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/33191abe2493419b91a6c40da029f81e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/33191abe2493419b91a6c40da029f81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-VolumesNegativeTest-1349531646 May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 33191abe2493419b91a6c40da029f81e May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-VolumesNegativeTest-1349531646 May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-VolumesNegativeTest-1349531646-project May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: d14a81fc4dda425ebf8d48fdbf174839 May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-VolumesNegativeTest-1349531646-project May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 7c6d9750-3969-4d0e-8973-3690ea41849e could not be found. May 12 17:51:16.656602 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '7c6d9750-3969-4d0e-8973-3690ea41849e'} May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6d9750-3969-4d0e-8973-3690ea41849e could not be found. May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:16.657738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6d9750-3969-4d0e-8973-3690ea41849e could not be found. May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6d9750-3969-4d0e-8973-3690ea41849e could not be found. May 12 17:51:16.659268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:51:16.660742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] Returning 404 to user: Instance 7c6d9750-3969-4d0e-8973-3690ea41849e could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:16.660742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-64b0e2e0-19b7-4653-a2b7-2e71becc37d7 tempest-VolumesNegativeTest-1349531646 tempest-VolumesNegativeTest-1349531646-project] 10.222.0.76 "GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e" status: 404 len: 111 microversion: 2.1 time: 0.030546 May 12 17:51:16.660742 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 564/1123] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:16 2022] GET /compute/v2.1/servers/7c6d9750-3969-4d0e-8973-3690ea41849e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:40.024108 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:40.024702 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-3c61b771-901f-4da6-863b-42c0f800c0af req-d941521d-3d51-4d31-9eae-c1367d3b9ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94af4804-8a27-4f9b-b471-7fa1a1dabedf", "tag": "4903dc03-9110-43e6-bfaf-db2e0fe64355"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:40.025409 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:40.034189 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:40.035047 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:40.036199 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:40.037613 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:40.042066 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-3c61b771-901f-4da6-863b-42c0f800c0af req-d941521d-3d51-4d31-9eae-c1367d3b9ff2 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:40.042659 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-3c61b771-901f-4da6-863b-42c0f800c0af req-d941521d-3d51-4d31-9eae-c1367d3b9ff2 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:40.069778 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:51:40.070577 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-3c61b771-901f-4da6-863b-42c0f800c0af req-d941521d-3d51-4d31-9eae-c1367d3b9ff2 service nova] Creating event network-changed:4903dc03-9110-43e6-bfaf-db2e0fe64355 for instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf on hv-cinder-83979 May 12 17:51:40.082262 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-3c61b771-901f-4da6-863b-42c0f800c0af req-d941521d-3d51-4d31-9eae-c1367d3b9ff2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059224 May 12 17:51:40.085015 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 565/1124] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:40.211018 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-63a7e47b-2ae4-4110-8414-6dfda4eb2644 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "DELETE /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 204 len: 0 microversion: 2.1 time: 0.193305 May 12 17:51:40.222621 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 560/1125] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:51:40 2022] DELETE /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:51:40.232959 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:40.234252 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:40.242882 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:40.243560 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:40.244529 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:40.245194 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:40.492116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:40.504379 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-a449985f-af0c-4211-ac6e-b8f57509b4b0 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.273703 May 12 17:51:40.505383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 566/1126] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:40 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:51:41.526117 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:41.528335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:41.544260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:41.547223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:41.549667 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:41.550291 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:41.818908 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:41.828967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-dceb368d-0a9d-4a7b-a14c-3dae875c6b0a tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1567 microversion: 2.1 time: 0.307816 May 12 17:51:41.832647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 561/1127] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:41 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:42.041783 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-7911be39-bbc2-4ee4-96e3-81a67487b9ab tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Action: 'create', calling method: .version_select at 0x7f24bc225790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-7351247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF84h2amSMHVOEnI4SrqysaETY2xbyGZVrYUA2bATUYAQ94SbXLLc4Qx4hq9T84mhv8DARGUrr5xR6B4rWGyNzCc1G2H2iyw6fy17/Db+YcMRowv/aJSW05p2DQzr7WdQ=="}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:42.056774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-7911be39-bbc2-4ee4-96e3-81a67487b9ab tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Getting quotas for project c3403873c6404cd1a227b411c653126f. Resources: {'key_pairs'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:51:42.062479 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.quota [None req-7911be39-bbc2-4ee4-96e3-81a67487b9ab tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Getting quotas for user 6ebf6077df894158babed9db4682d730 and project c3403873c6404cd1a227b411c653126f. Resources: {'key_pairs'} {{(pid=123689) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:51:42.088599 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-7911be39-bbc2-4ee4-96e3-81a67487b9ab tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.050668 May 12 17:51:42.089572 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 567/1128] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 12 17:51:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:42.212236 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-770647469", "imageRef": "a19a4901-0066-4b8e-93ac-8a0eeed60ed3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-7351247", "networks": [{"uuid": "1b01b3c7-1729-4430-8c0d-0413e4982878"}]}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:42.271626 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.network.neutron [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] validate_networks() for [('1b01b3c7-1729-4430-8c0d-0413e4982878', None, None, None, None, None)] {{(pid=123688) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:51:42.853084 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-b74f55ad-3860-49bd-9c18-9211e3f979cb req-66cbf182-924d-4dea-a2a5-bb417902b499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94af4804-8a27-4f9b-b471-7fa1a1dabedf", "name": "network-vif-deleted", "tag": "4903dc03-9110-43e6-bfaf-db2e0fe64355"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:42.871077 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-b74f55ad-3860-49bd-9c18-9211e3f979cb req-66cbf182-924d-4dea-a2a5-bb417902b499 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:42.871551 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-b74f55ad-3860-49bd-9c18-9211e3f979cb req-66cbf182-924d-4dea-a2a5-bb417902b499 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:42.887801 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-b74f55ad-3860-49bd-9c18-9211e3f979cb req-66cbf182-924d-4dea-a2a5-bb417902b499 service nova] Creating event network-vif-deleted:4903dc03-9110-43e6-bfaf-db2e0fe64355 for instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf on hv-cinder-83979 May 12 17:51:42.895721 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-b74f55ad-3860-49bd-9c18-9211e3f979cb req-66cbf182-924d-4dea-a2a5-bb417902b499 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050117 May 12 17:51:42.896768 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 568/1129] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:51:42.908660 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:42.909453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:42.922313 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:42.923050 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:42.924317 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:42.924896 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:42.993949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Flavor limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:51:42.993949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Image limits 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:51:42.993949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Flavor pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:51:42.993949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Image pref 0:0:0 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:51:42.993949 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.virt.hardware [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123688) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:51:43.008670 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afcd57a10c14963acd187bd2aabb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ee24fd13d4432a040a745bf2a0d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:43.014889 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:43.015520 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:43.016571 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:43.017270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:43.021709 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e655d248-a9a3-4d51-81d2-0343050494dd tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 200 len: 1219 microversion: 2.1 time: 0.119710 May 12 17:51:43.028792 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 569/1130] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:42 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:43.040729 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Getting quotas for project c3403873c6404cd1a227b411c653126f. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:51:43.048802 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.quota [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Getting quotas for user 6ebf6077df894158babed9db4682d730 and project c3403873c6404cd1a227b411c653126f. Resources: {'cores', 'instances', 'ram'} {{(pid=123688) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:51:43.062317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Going to run 1 instances... {{(pid=123688) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:51:43.065736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a19a4901-0066-4b8e-93ac-8a0eeed60ed3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123688) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:51:43.124183 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-bb2d1f1f-e85f-46c4-af88-e935a7f0e78d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915785 May 12 17:51:43.124833 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 562/1131] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 12 17:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:51:43.141803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-de8944fc-6990-411f-9b32-fdaef619eec4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:43.143177 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-de8944fc-6990-411f-9b32-fdaef619eec4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:43.248522 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-de8944fc-6990-411f-9b32-fdaef619eec4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:43.257102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-de8944fc-6990-411f-9b32-fdaef619eec4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1255 microversion: 2.1 time: 0.121053 May 12 17:51:43.257677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 570/1132] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:43 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1255 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:51:44.039620 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:44.040198 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] [instance: 94af4804-8a27-4f9b-b471-7fa1a1dabedf] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:44.047447 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:44.047908 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:44.048720 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:44.049161 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:44.062768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] HTTP exception thrown: Instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf could not be found. May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Request method failure captured: May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf HTTP/1.1 May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUfbdtvC8YqQfL437HlC0p6bzQtRD-hS4KM52DLqoi0tLE6-lUwuwwW7SBzdsyxOlQQljCny4mVcwEVoQbBAvrwuxachCSU8FiYFCfZ5vnMYS6hyz0IO2E_MFcK0dvfwW4tmRvcCNyvRJwIBQVKTA5PtOOmFVDPi7IgffqBn0Ugx9C4 May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 667ee24fd13d4432a040a745bf2a0d0e May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-TestShelveInstance-2093443376 May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:51:44.064427 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/667ee24fd13d4432a040a745bf2a0d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_667ee24fd13d4432a040a745bf2a0d0e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/667ee24fd13d4432a040a745bf2a0d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/667ee24fd13d4432a040a745bf2a0d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-TestShelveInstance-2093443376 May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 667ee24fd13d4432a040a745bf2a0d0e May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-TestShelveInstance-2093443376 May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-TestShelveInstance-2093443376-project May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 2afcd57a10c14963acd187bd2aabb229 May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-TestShelveInstance-2093443376-project May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf could not be found. May 12 17:51:44.066935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '94af4804-8a27-4f9b-b471-7fa1a1dabedf'} May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf could not be found. May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:44.068512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf could not be found. May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf could not be found. May 12 17:51:44.070848 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:51:44.073078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Returning 404 to user: Instance 94af4804-8a27-4f9b-b471-7fa1a1dabedf could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:44.073078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b0af36c7-ec96-4d01-a448-308358b88027 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf" status: 404 len: 111 microversion: 2.1 time: 0.030406 May 12 17:51:44.073078 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 563/1133] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:44 2022] GET /compute/v2.1/servers/94af4804-8a27-4f9b-b471-7fa1a1dabedf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:44.278944 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:44.280455 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:44.288648 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:44.289016 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:44.294504 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:44.294934 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:44.338048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-837bcc37-9103-4a2f-b9ab-94e6be8c2f85 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] Calling method '.version_select at 0x7f24bc2cbf70>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:44.361955 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-837bcc37-9103-4a2f-b9ab-94e6be8c2f85 tempest-TestShelveInstance-2093443376 tempest-TestShelveInstance-2093443376-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2097308627" status: 202 len: 0 microversion: 2.1 time: 0.028436 May 12 17:51:44.363811 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 564/1134] 10.222.0.76 () {58 vars in 1253 bytes} [Thu May 12 17:51:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2097308627 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:51:44.382732 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:44.392768 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-01e2b45f-cbb5-485b-8c7f-696478831039 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1325 microversion: 2.1 time: 0.119161 May 12 17:51:44.406712 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 571/1135] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:44 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1325 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:45.417105 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:45.418355 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:45.435704 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:45.436580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:45.437698 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:45.438455 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:45.719581 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:45.733580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a2f772bb-4139-4f10-b0c9-7f636d16caa8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.318392 May 12 17:51:45.733580 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 565/1136] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:45 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:46.759423 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:46.760131 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:46.768383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:46.769250 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:46.770264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:46.770978 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:47.111031 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:47.118660 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-3e11f529-1009-4f9c-b777-c56e2aaceacd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.370753 May 12 17:51:47.131093 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 572/1137] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:46 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:48.138474 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:48.139860 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:48.152171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:48.153190 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:48.154341 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:48.155270 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:48.468495 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:48.479079 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-c94b0399-8417-4fb1-b89c-665003c73fac tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.346276 May 12 17:51:48.479959 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 566/1138] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:48 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:49.497930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:49.500272 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:49.521482 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:49.522805 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:49.525183 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:49.525642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:49.717172 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:49.725076 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-72fcac25-ad48-4b65-8a8f-2a506cfb07cd tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.232389 May 12 17:51:49.725747 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 573/1139] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:49 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:50.754829 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:50.755826 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:50.767382 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:50.768217 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:50.769317 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:50.770096 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:51.059328 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:51.080085 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1fcc4967-9e91-4105-a69d-02f3e97b9593 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.331913 May 12 17:51:51.095352 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 567/1140] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:50 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:52.112314 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:52.112939 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:52.120919 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:52.121671 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:52.122716 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:52.123373 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:52.405963 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:52.415281 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-07190419-0d9c-4c9e-9f44-547fae646df1 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.315410 May 12 17:51:52.426967 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 574/1141] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:52 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:53.434466 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:53.435126 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:53.441591 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:53.442190 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:53.443030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:53.443980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:53.625782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:53.633150 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1c713f23-adb9-4971-9945-dedd48417049 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.203628 May 12 17:51:53.633724 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 568/1142] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:53 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:54.652441 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:54.653806 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:54.679265 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:54.679813 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:54.680942 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:54.681381 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:54.892638 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-058e4d2d-fed4-4082-8e32-ec108d702785 req-c04a7a8d-8252-4846-b4a0-614b4d055283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49a96bf-7f9d-40ea-a47a-574324e1ea5e", "tag": "fe5c5155-9974-49dd-9f2a-127350bb4e70"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:54.895733 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:54.905781 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2a3bb5b9-96d2-4127-8869-7147efc7c1c7 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.260066 May 12 17:51:54.908164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-058e4d2d-fed4-4082-8e32-ec108d702785 req-c04a7a8d-8252-4846-b4a0-614b4d055283 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:54.908691 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-058e4d2d-fed4-4082-8e32-ec108d702785 req-c04a7a8d-8252-4846-b4a0-614b4d055283 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:54.924939 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-058e4d2d-fed4-4082-8e32-ec108d702785 req-c04a7a8d-8252-4846-b4a0-614b4d055283 service nova] Creating event network-changed:fe5c5155-9974-49dd-9f2a-127350bb4e70 for instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e on hv-cinder-83979 May 12 17:51:54.926759 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 575/1143] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:54 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:54.932352 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-058e4d2d-fed4-4082-8e32-ec108d702785 req-c04a7a8d-8252-4846-b4a0-614b4d055283 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043662 May 12 17:51:54.937234 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 569/1144] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:51:55.923738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:55.924358 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:55.930646 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:55.931117 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:55.931876 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:55.932315 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:56.067358 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:56.076219 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-1e41d414-08ac-40c8-b129-fe7c0af4e313 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.156465 May 12 17:51:56.076794 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 576/1145] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:55 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:57.094015 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:57.094738 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:57.100786 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:57.101239 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:57.102010 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:57.102448 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:57.239101 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:57.248971 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e5654d5e-5a5a-44dc-a3e1-1ed85de8865c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.159588 May 12 17:51:57.249789 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 570/1146] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:57 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:58.265982 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:58.266582 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:58.273178 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:58.273625 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:58.274421 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:58.274892 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:58.401257 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:58.408470 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d2e4ed6a-4527-42ed-985f-df8bd3dacd7e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.146369 May 12 17:51:58.409035 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 577/1147] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:58 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:59.425655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:59.426267 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:59.432893 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:59.433347 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:59.434140 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:59.434584 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:59.567305 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:59.575488 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e32cdf5f-41f2-4130-aa94-50d4c4e49849 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.153769 May 12 17:51:59.576061 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 571/1148] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:51:59 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:00.593893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:00.594498 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:00.600764 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:00.601207 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:00.601954 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:00.602412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:00.735630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:00.742819 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ceb9d019-9964-48ca-b5d1-bcc5bbcf026d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.152767 May 12 17:52:00.743373 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 578/1149] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:00 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:01.760468 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:01.761857 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:01.768565 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:01.769019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:01.769794 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:01.770235 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:01.900877 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:01.909009 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-b339d60f-91e0-46f6-9bb2-de58c0e4d865 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.152533 May 12 17:52:01.909564 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 572/1150] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:01 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:02.926262 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:02.926885 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:02.933897 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:02.934367 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:02.935154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:02.935595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:03.067455 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:03.076391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-11d117fc-5916-4ba5-861c-96a35eb3864f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.154086 May 12 17:52:03.085686 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 579/1151] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:02 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:03.107374 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-f63da3ba-4882-4ef8-928a-09c9c8ba408c req-60dcad03-17b6-4d2a-8562-edae1d356901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49a96bf-7f9d-40ea-a47a-574324e1ea5e", "name": "network-vif-plugged", "status": "completed", "tag": "fe5c5155-9974-49dd-9f2a-127350bb4e70"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:03.116167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f63da3ba-4882-4ef8-928a-09c9c8ba408c req-60dcad03-17b6-4d2a-8562-edae1d356901 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:03.116538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-f63da3ba-4882-4ef8-928a-09c9c8ba408c req-60dcad03-17b6-4d2a-8562-edae1d356901 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:03.129704 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-f63da3ba-4882-4ef8-928a-09c9c8ba408c req-60dcad03-17b6-4d2a-8562-edae1d356901 service nova] Creating event network-vif-plugged:fe5c5155-9974-49dd-9f2a-127350bb4e70 for instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e on hv-cinder-83979 May 12 17:52:03.146106 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-f63da3ba-4882-4ef8-928a-09c9c8ba408c req-60dcad03-17b6-4d2a-8562-edae1d356901 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042852 May 12 17:52:03.147496 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 573/1152] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:04.093496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:04.094103 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:04.100419 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:04.100876 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:04.101975 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:04.102412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:04.232823 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:04.240248 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-297ae013-fbb3-43e2-9a18-1b942920ea91 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1355 microversion: 2.1 time: 0.150488 May 12 17:52:04.240711 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 580/1153] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:04 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1355 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:05.257639 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:05.258328 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:05.264823 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.265268 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.266030 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.266462 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.397335 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:05.405854 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-32287b5b-25f9-4b75-b61b-5907d9140a3c tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1545 microversion: 2.1 time: 0.152932 May 12 17:52:05.406410 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 574/1154] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:05 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:05.422303 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:05.422945 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:05.429307 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.429761 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.430526 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.431005 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.556795 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:05.564430 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-c594e459-e91d-4a51-b1ba-0b57a54ae312 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1545 microversion: 2.1 time: 0.146021 May 12 17:52:05.564994 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 581/1155] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:05 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1545 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:05.579827 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:05.583229 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:05.583980 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Searching by: {'deleted': False, 'project_id': 'c3403873c6404cd1a227b411c653126f'} {{(pid=123688) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 17:52:05.592553 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.592837 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.593643 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.594080 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.683838 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.multi_cell_list [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123688) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 17:52:05.779647 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-1be274b1-8b9a-4ac3-abd2-620dab340bf8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203540 May 12 17:52:05.780230 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 575/1156] 10.222.0.76 () {58 vars in 1124 bytes} [Thu May 12 17:52:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:05.790150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:05.790826 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:05.796815 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.797270 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.798276 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.798735 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.927480 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:05.935329 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ac171d12-af14-4a7d-8c8e-a4ae5bd8fb79 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1545 microversion: 2.1 time: 0.148960 May 12 17:52:05.935893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 582/1157] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:05 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1545 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:09.714157 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d92b7fac-2f5b-4ce8-a284-2d328225571f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccc55912-8f79-425c-9f84-5bbe67e2b989"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:09.715234 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d92b7fac-2f5b-4ce8-a284-2d328225571f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:09.721784 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d92b7fac-2f5b-4ce8-a284-2d328225571f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:09.722247 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d92b7fac-2f5b-4ce8-a284-2d328225571f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:09.723043 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d92b7fac-2f5b-4ce8-a284-2d328225571f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:09.723480 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d92b7fac-2f5b-4ce8-a284-2d328225571f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:09.955489 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d92b7fac-2f5b-4ce8-a284-2d328225571f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245660 May 12 17:52:09.956111 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 576/1158] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 12 17:52:09 2022] POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:17.544027 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:17.544642 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:17.551256 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:17.551807 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:17.552591 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:17.553028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:17.689110 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:17.697070 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-ad5f28a0-3eb2-4a21-bbb1-97a4a5d6e975 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1591 microversion: 2.1 time: 0.157888 May 12 17:52:17.697677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 583/1159] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:17 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1591 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:19.607709 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-e2e18d46-9f71-4da6-9bd2-53deae2a873c req-71604253-43f6-4855-a921-e8afe19a944c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49a96bf-7f9d-40ea-a47a-574324e1ea5e", "tag": "fe5c5155-9974-49dd-9f2a-127350bb4e70"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:19.616416 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-e2e18d46-9f71-4da6-9bd2-53deae2a873c req-71604253-43f6-4855-a921-e8afe19a944c service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:19.616959 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-e2e18d46-9f71-4da6-9bd2-53deae2a873c req-71604253-43f6-4855-a921-e8afe19a944c service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:19.628572 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-e2e18d46-9f71-4da6-9bd2-53deae2a873c req-71604253-43f6-4855-a921-e8afe19a944c service nova] Creating event network-changed:fe5c5155-9974-49dd-9f2a-127350bb4e70 for instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e on hv-cinder-83979 May 12 17:52:19.634175 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-e2e18d46-9f71-4da6-9bd2-53deae2a873c req-71604253-43f6-4855-a921-e8afe19a944c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031494 May 12 17:52:19.635842 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 577/1160] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:20.663665 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-154583875"}} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:20.664534 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:20.672491 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:20.673062 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:20.673918 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:20.674424 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.173131 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.network.security_group_api [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Adding security group ddb2b66f-ec85-4fdc-8ab3-c8264368a69d to port fe5c5155-9974-49dd-9f2a-127350bb4e70 May 12 17:52:21.752850 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:21.753440 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:21.761562 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.762167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.763164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.763608 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.795955 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:52:21.828291 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2b71c079-c1a4-406d-99b6-631a8d690c04 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/action" status: 202 len: 0 microversion: 2.1 time: 1.168993 May 12 17:52:21.829420 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 584/1161] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:52:20 2022] POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/action => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:52:21.835107 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-fb99b832-47da-4f1a-bfa4-f67666f47927 req-6835fc67-cd63-450e-9e3d-ad03ce323e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050e8718-e2ab-4e72-b674-2dee39306e04", "tag": "9080bbb4-c021-4c41-9e20-56892559bb65"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:21.850799 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-fb99b832-47da-4f1a-bfa4-f67666f47927 req-6835fc67-cd63-450e-9e3d-ad03ce323e0a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.851392 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-fb99b832-47da-4f1a-bfa4-f67666f47927 req-6835fc67-cd63-450e-9e3d-ad03ce323e0a service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.873920 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-fb99b832-47da-4f1a-bfa4-f67666f47927 req-6835fc67-cd63-450e-9e3d-ad03ce323e0a service nova] Creating event network-changed:9080bbb4-c021-4c41-9e20-56892559bb65 for instance 050e8718-e2ab-4e72-b674-2dee39306e04 on hv-cinder-83979 May 12 17:52:21.881568 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-fb99b832-47da-4f1a-bfa4-f67666f47927 req-6835fc67-cd63-450e-9e3d-ad03ce323e0a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050537 May 12 17:52:21.882964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 585/1162] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:21.890418 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:21.891351 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:21.898380 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.899258 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.900116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.900809 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.930655 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-2f3f694c-0ae2-4a02-b4ff-cdfeba25c942 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "DELETE /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 204 len: 0 microversion: 2.1 time: 0.182931 May 12 17:52:21.935293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 578/1163] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:52:21 2022] DELETE /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 17:52:21.940781 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:21.941478 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:21.948551 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.949390 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.950339 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.951014 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:22.084268 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:22.093717 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-02f7d837-0d15-456c-989a-d9cf7ea6e5f8 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1756 microversion: 2.1 time: 0.209303 May 12 17:52:22.094618 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 586/1164] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:21 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:22.104845 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:22.112616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-072239a7-92cf-4688-b455-46a22a5413e0 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1579 microversion: 2.1 time: 0.176051 May 12 17:52:22.113228 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 579/1165] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:21 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:23.132156 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:23.132690 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:23.139070 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:23.139528 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:23.140300 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:23.140738 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:23.270368 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:23.279114 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-d6bd771b-c35b-4255-b600-4425863402a7 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1579 microversion: 2.1 time: 0.151254 May 12 17:52:23.279692 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 587/1166] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:23 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:23.897087 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-65e339d7-fa7b-41e4-9408-baa0c528914a req-752a7394-4b2e-470b-9c5a-4a80c8122d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49a96bf-7f9d-40ea-a47a-574324e1ea5e", "tag": "fe5c5155-9974-49dd-9f2a-127350bb4e70"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:23.906515 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-65e339d7-fa7b-41e4-9408-baa0c528914a req-752a7394-4b2e-470b-9c5a-4a80c8122d52 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:23.907103 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-65e339d7-fa7b-41e4-9408-baa0c528914a req-752a7394-4b2e-470b-9c5a-4a80c8122d52 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:23.921630 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-65e339d7-fa7b-41e4-9408-baa0c528914a req-752a7394-4b2e-470b-9c5a-4a80c8122d52 service nova] Creating event network-changed:fe5c5155-9974-49dd-9f2a-127350bb4e70 for instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e on hv-cinder-83979 May 12 17:52:23.926635 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-65e339d7-fa7b-41e4-9408-baa0c528914a req-752a7394-4b2e-470b-9c5a-4a80c8122d52 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033185 May 12 17:52:23.927260 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 580/1167] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:24.296114 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:24.296728 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:24.303217 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.303668 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:24.304434 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.304874 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:24.438843 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:24.446157 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-6c5e2f0a-e734-4d82-bf01-dc923d11ae0a tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1579 microversion: 2.1 time: 0.153957 May 12 17:52:24.446872 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 588/1168] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:24 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:25.464736 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:25.465538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:25.472341 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:25.472792 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:25.473583 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:25.474022 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:25.698431 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:25.705935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ac1fe008-5ab4-4e61-a1e9-dba0a52ac98b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1579 microversion: 2.1 time: 0.246132 May 12 17:52:25.706659 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 581/1169] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:25 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1579 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:25.936021 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-5a5453d4-5469-4d87-9a23-4559131c06e6 req-86e601a9-0b5d-4da4-9614-2ad8e5209143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050e8718-e2ab-4e72-b674-2dee39306e04", "name": "network-vif-deleted", "tag": "9080bbb4-c021-4c41-9e20-56892559bb65"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:25.944580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-5a5453d4-5469-4d87-9a23-4559131c06e6 req-86e601a9-0b5d-4da4-9614-2ad8e5209143 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:25.945028 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-5a5453d4-5469-4d87-9a23-4559131c06e6 req-86e601a9-0b5d-4da4-9614-2ad8e5209143 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:25.956116 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-5a5453d4-5469-4d87-9a23-4559131c06e6 req-86e601a9-0b5d-4da4-9614-2ad8e5209143 service nova] Creating event network-vif-deleted:9080bbb4-c021-4c41-9e20-56892559bb65 for instance 050e8718-e2ab-4e72-b674-2dee39306e04 on hv-cinder-83979 May 12 17:52:25.960955 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-5a5453d4-5469-4d87-9a23-4559131c06e6 req-86e601a9-0b5d-4da4-9614-2ad8e5209143 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028636 May 12 17:52:25.961525 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 589/1170] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:26.722958 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:26.723561 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:26.730258 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:26.730731 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:26.731495 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:26.731927 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:26.796882 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:26.804372 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-0f9760b0-9496-48ca-9737-0b247805bc9b tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1511 microversion: 2.1 time: 0.085266 May 12 17:52:26.804969 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 582/1171] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:26 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:27.825955 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:27.827474 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:27.834386 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.835048 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.835887 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.836414 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.913279 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:27.921209 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5d7be348-1544-41d3-b22e-8a26c6de531c tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 200 len: 1225 microversion: 2.1 time: 0.102064 May 12 17:52:27.921790 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 590/1172] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:27 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:28.937542 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:28.938130 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 050e8718-e2ab-4e72-b674-2dee39306e04] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:28.944349 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.944797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.945599 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.946039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.960143 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] HTTP exception thrown: Instance 050e8718-e2ab-4e72-b674-2dee39306e04 could not be found. May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Request method failure captured: May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 HTTP/1.1 May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUdrJ391YR7XyDmG4-sRSiCeHMnXU_QmSYzk5bNRNXzdx9CzUlKhghKMNOq52Z428RJqED_5A3D8fvmJc-ZqT8wv_EPtIOHX1fkKyAQ4WlVajLVpijqCXn9LwovVG47dzcHQxXNHf4GjCnZnviES9-dOMFwJvOgXIxITgGPh1DVY5qo May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:52:28.961911 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4e9154d1a4c44c6b8a42001c659d069b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-TestVolumeBootPattern-386813284 May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 7802c329d4ca4eccb28fdec9f8082cc1 May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 050e8718-e2ab-4e72-b674-2dee39306e04 could not be found. May 12 17:52:28.964100 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '050e8718-e2ab-4e72-b674-2dee39306e04'} May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 050e8718-e2ab-4e72-b674-2dee39306e04 could not be found. May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:28.964930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 050e8718-e2ab-4e72-b674-2dee39306e04 could not be found. May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 050e8718-e2ab-4e72-b674-2dee39306e04 could not be found. May 12 17:52:28.966287 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:28.967633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Returning 404 to user: Instance 050e8718-e2ab-4e72-b674-2dee39306e04 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:28.967633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-26377509-92d6-44f6-9618-c2b233ca6421 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04" status: 404 len: 111 microversion: 2.1 time: 0.030578 May 12 17:52:28.967633 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 583/1173] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:28 2022] GET /compute/v2.1/servers/050e8718-e2ab-4e72-b674-2dee39306e04 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:52:34.160488 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:34.161052 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:34.162177 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-e3160201-8747-4c75-a8ae-9bf6b9e9928c req-c59fbf31-7a1b-4d2b-bd47-6721cf019901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5", "tag": "fac993c6-5c0c-429d-9df1-25372f4535e2"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:34.168623 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.169366 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.170337 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.170999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.171405 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-e3160201-8747-4c75-a8ae-9bf6b9e9928c req-c59fbf31-7a1b-4d2b-bd47-6721cf019901 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.171855 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-e3160201-8747-4c75-a8ae-9bf6b9e9928c req-c59fbf31-7a1b-4d2b-bd47-6721cf019901 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.184309 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-e3160201-8747-4c75-a8ae-9bf6b9e9928c req-c59fbf31-7a1b-4d2b-bd47-6721cf019901 service nova] Creating event network-changed:fac993c6-5c0c-429d-9df1-25372f4535e2 for instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 on hv-cinder-83979 May 12 17:52:34.189538 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-e3160201-8747-4c75-a8ae-9bf6b9e9928c req-c59fbf31-7a1b-4d2b-bd47-6721cf019901 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030976 May 12 17:52:34.190559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 584/1174] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:52:34.199836 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Going to try to terminate instance {{(pid=123689) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:52:34.300785 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-258f655c-812c-4dfc-baca-eeb843b37700 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "DELETE /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 204 len: 0 microversion: 2.1 time: 0.144734 May 12 17:52:34.301496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 591/1175] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:52:34 2022] DELETE /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:52:34.311211 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:34.312050 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:34.318252 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.318895 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.319923 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.320559 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.470278 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:34.477826 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-35b67e0f-f460-4714-bbb9-ec2c8cfae577 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1579 microversion: 2.1 time: 0.171932 May 12 17:52:34.479393 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 585/1176] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:34 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:35.496998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:35.497887 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:35.504228 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:35.504684 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:35.505454 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:35.505900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:35.642749 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:35.651061 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-11082f47-aaef-49c1-923d-51b183825f96 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1579 microversion: 2.1 time: 0.158293 May 12 17:52:35.651636 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 592/1177] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:35 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:36.552933 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-238b34c0-b651-4a95-a9bc-5aad039f1211 req-80b871af-1d12-47f6-90d6-9bbeaa3bb8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5", "name": "network-vif-deleted", "tag": "fac993c6-5c0c-429d-9df1-25372f4535e2"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:36.563768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-238b34c0-b651-4a95-a9bc-5aad039f1211 req-80b871af-1d12-47f6-90d6-9bbeaa3bb8d6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.564577 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-238b34c0-b651-4a95-a9bc-5aad039f1211 req-80b871af-1d12-47f6-90d6-9bbeaa3bb8d6 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.577358 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-238b34c0-b651-4a95-a9bc-5aad039f1211 req-80b871af-1d12-47f6-90d6-9bbeaa3bb8d6 service nova] Creating event network-vif-deleted:fac993c6-5c0c-429d-9df1-25372f4535e2 for instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 on hv-cinder-83979 May 12 17:52:36.583256 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-238b34c0-b651-4a95-a9bc-5aad039f1211 req-80b871af-1d12-47f6-90d6-9bbeaa3bb8d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034066 May 12 17:52:36.584023 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 586/1178] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:36.668140 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:36.668751 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:36.675154 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.675616 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.676391 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.676828 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.736999 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7802c329d4ca4eccb28fdec9f8082cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9154d1a4c44c6b8a42001c659d069b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:36.745334 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f8c40fd2-8621-485d-8453-e1fce2125275 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 200 len: 1225 microversion: 2.1 time: 0.080123 May 12 17:52:36.745899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 593/1179] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:36 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:37.763429 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:37.764117 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:37.770617 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:37.771093 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:37.771878 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:37.772314 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:37.786176 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] HTTP exception thrown: Instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 could not be found. May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Request method failure captured: May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 HTTP/1.1 May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUdrJ391YR7XyDmG4-sRSiCeHMnXU_QmSYzk5bNRNXzdx9CzUlKhghKMNOq52Z428RJqED_5A3D8fvmJc-ZqT8wv_EPtIOHX1fkKyAQ4WlVajLVpijqCXn9LwovVG47dzcHQxXNHf4GjCnZnviES9-dOMFwJvOgXIxITgGPh1DVY5qo May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:52:37.787768 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4e9154d1a4c44c6b8a42001c659d069b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-TestVolumeBootPattern-386813284 May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 7802c329d4ca4eccb28fdec9f8082cc1 May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 could not be found. May 12 17:52:37.789430 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': 'befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5'} May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 could not be found. May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:37.790362 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 could not be found. May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 could not be found. May 12 17:52:37.791935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:37.793880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Returning 404 to user: Instance befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:37.793880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4cc2c873-af2f-4f81-9dd4-b581b0cd74f1 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5" status: 404 len: 111 microversion: 2.1 time: 0.030707 May 12 17:52:37.793880 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 587/1180] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:37 2022] GET /compute/v2.1/servers/befa371c-2fe8-4fc6-a78f-2f7fbbf9bcb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:52:38.228821 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:38.229328 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:38.236386 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.236846 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.237626 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.238068 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.251677 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] HTTP exception thrown: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Request method failure captured: May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 HTTP/1.1 May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUdrJ391YR7XyDmG4-sRSiCeHMnXU_QmSYzk5bNRNXzdx9CzUlKhghKMNOq52Z428RJqED_5A3D8fvmJc-ZqT8wv_EPtIOHX1fkKyAQ4WlVajLVpijqCXn9LwovVG47dzcHQxXNHf4GjCnZnviES9-dOMFwJvOgXIxITgGPh1DVY5qo May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:52:38.253382 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4e9154d1a4c44c6b8a42001c659d069b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-TestVolumeBootPattern-386813284 May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 7802c329d4ca4eccb28fdec9f8082cc1 May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.255091 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': '58a1ff6d-1105-476b-880e-39e5d783b0a2'} May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:38.256043 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.257601 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:52:38.259199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Returning 404 to user: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:38.259199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5521e80b-952e-4924-a709-a0d1b9d9d989 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "DELETE /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 404 len: 111 microversion: 2.1 time: 0.029876 May 12 17:52:38.259199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 594/1181] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:52:38 2022] DELETE /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:52:38.263712 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:38.264322 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] [instance: 58a1ff6d-1105-476b-880e-39e5d783b0a2] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:38.270223 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.270700 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.271459 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.271891 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.285253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.wsgi [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] HTTP exception thrown: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Request method failure captured: May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: request: GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 HTTP/1.1 May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept: application/json May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Accept-Encoding: identity May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Connection: close May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Length: 0 May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Content-Type: application/json May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Host: 10.222.0.76 May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Openstack-System-Scope: None May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: User-Agent: python-urllib3/1.26.9 May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Auth-Token: gAAAAABifUdrJ391YR7XyDmG4-sRSiCeHMnXU_QmSYzk5bNRNXzdx9CzUlKhghKMNOq52Z428RJqED_5A3D8fvmJc-ZqT8wv_EPtIOHX1fkKyAQ4WlVajLVpijqCXn9LwovVG47dzcHQxXNHf4GjCnZnviES9-dOMFwJvOgXIxITgGPh1DVY5qo May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Id: None May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Domain-Name: None May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Identity-Status: Confirmed May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Is-Admin-Project: True May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Id: default May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Domain-Name: Default May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Project-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Role: member,reader May 12 17:52:38.286804 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Roles: member,reader May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4e9154d1a4c44c6b8a42001c659d069b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4e9154d1a4c44c6b8a42001c659d069b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant: tempest-TestVolumeBootPattern-386813284 May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Id: 4e9154d1a4c44c6b8a42001c659d069b May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-Tenant-Name: tempest-TestVolumeBootPattern-386813284 May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Id: default May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Domain-Name: Default May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Id: 7802c329d4ca4eccb28fdec9f8082cc1 May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: X-User-Name: tempest-TestVolumeBootPattern-386813284-project May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: method: > May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: exception: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.288516 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: action_args: {'id': '58a1ff6d-1105-476b-880e-39e5d783b0a2'} May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:38.289419 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. May 12 17:52:38.291016 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: ERROR nova.api.openstack.wsgi May 12 17:52:38.295329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Returning 404 to user: Instance 58a1ff6d-1105-476b-880e-39e5d783b0a2 could not be found. {{(pid=123688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:38.295329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-f0447261-01bd-4183-bb25-f946e20dc261 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2" status: 404 len: 111 microversion: 2.1 time: 0.028709 May 12 17:52:38.295329 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 588/1182] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:38 2022] GET /compute/v2.1/servers/58a1ff6d-1105-476b-880e-39e5d783b0a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:52:39.572893 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-29f81571-9cba-4535-aa14-aa3e55cfc670 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] Calling method '.version_select at 0x7f24bc34d280>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:39.592502 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-29f81571-9cba-4535-aa14-aa3e55cfc670 tempest-TestVolumeBootPattern-386813284 tempest-TestVolumeBootPattern-386813284-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-235511178" status: 202 len: 0 microversion: 2.1 time: 0.023618 May 12 17:52:39.593102 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 595/1183] 10.222.0.76 () {58 vars in 1259 bytes} [Thu May 12 17:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-235511178 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:52:47.547254 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-fb2a21af-72b6-4e87-accd-8bb0e671da6a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:47.548204 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-fb2a21af-72b6-4e87-accd-8bb0e671da6a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:47.554512 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb2a21af-72b6-4e87-accd-8bb0e671da6a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:47.554988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb2a21af-72b6-4e87-accd-8bb0e671da6a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:47.555739 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb2a21af-72b6-4e87-accd-8bb0e671da6a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:47.556167 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-fb2a21af-72b6-4e87-accd-8bb0e671da6a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:47.630463 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-fb2a21af-72b6-4e87-accd-8bb0e671da6a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/action" status: 202 len: 0 microversion: 2.1 time: 0.087933 May 12 17:52:47.631444 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 589/1184] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:52:47 2022] POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:52:47.640199 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:47.640811 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:47.648594 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:47.649051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:47.649964 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:47.650537 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:47.999900 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:48.007811 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2cef23e3-6549-4555-b46e-d84be7376a97 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1748 microversion: 2.1 time: 0.372144 May 12 17:52:48.008377 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 596/1185] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:47 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1748 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:49.026062 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:49.026831 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:49.034434 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:49.034924 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:49.035709 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:49.036148 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:49.235610 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:49.243422 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-e6b2ef3a-6bfb-4dc0-bc9c-84390d58fd52 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.221836 May 12 17:52:49.243978 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 590/1186] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:49 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:50.261359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:50.262095 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:50.268138 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:50.268592 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:50.269359 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:50.269793 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:50.419556 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:50.427308 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e4247a81-d47a-4cb8-b058-d5717d8f6326 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.169848 May 12 17:52:50.427878 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 597/1187] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:50 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:51.445007 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:51.445615 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:51.452595 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:51.453048 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:51.453813 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:51.454253 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:51.601644 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:51.609533 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-db025cab-96ed-40ea-98b0-8c0e2997165e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.168410 May 12 17:52:51.610127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 591/1188] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:51 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:52.626003 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:52.626612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:52.633185 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:52.633639 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:52.634412 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:52.635120 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:52.777914 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:52.786045 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-f52c1f5a-6fe1-431b-8754-8681f83b7078 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.163918 May 12 17:52:52.786616 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 598/1189] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:52 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:53.803171 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:53.803782 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:53.810259 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:53.810717 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:53.811497 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:53.811935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:53.953073 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:53.960807 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-207459b2-feac-4d05-809a-457aa167d45d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.161440 May 12 17:52:53.961369 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 592/1190] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:53 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:54.978945 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:54.979585 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:54.986073 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:54.986521 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:54.987318 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:54.987779 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:55.125455 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:55.133107 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-0f7eb6cd-2695-494d-8160-3c41066b59c4 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.158159 May 12 17:52:55.133666 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 599/1191] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:54 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:56.151456 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:56.152099 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:56.158696 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:56.159164 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:56.159935 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:56.160375 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:56.305900 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:56.314172 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-16100b4c-1801-459c-a684-760a5bdce024 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.166820 May 12 17:52:56.314766 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 593/1192] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:56 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:57.330848 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:57.331433 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:57.337707 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:57.338147 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:57.338923 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:57.339362 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:57.486196 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:57.494051 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-e3c69a7f-40e7-4ff3-bce0-31db6a817cce tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.167020 May 12 17:52:57.494558 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 600/1193] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:57 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:58.512293 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:58.513039 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:58.519127 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:58.519576 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:58.520338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:58.520769 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:58.663192 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:58.671851 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-a8d19946-ebe6-4496-973c-9404b5b5175d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1753 microversion: 2.1 time: 0.164174 May 12 17:52:58.672412 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 594/1194] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:58 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:59.689153 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:59.689769 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:59.696150 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:59.696605 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:59.697373 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:59.697812 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:59.837714 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:59.845686 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-76f5dba7-125f-47a9-b771-bb00f114afc9 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1756 microversion: 2.1 time: 0.160396 May 12 17:52:59.846262 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 601/1195] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:52:59 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:02.936580 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:53:02.937281 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Thu May 12 17:53:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:53:32.340091 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-154583875"}} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:32.340677 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:32.347391 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:32.347842 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:32.348606 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:32.349046 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:32.473060 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.network.security_group_api [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Removing security group ddb2b66f-ec85-4fdc-8ab3-c8264368a69d from port fe5c5155-9974-49dd-9f2a-127350bb4e70 May 12 17:53:32.843987 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-d27bb5e4-86d9-477e-a810-e645b20d36be tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/action" status: 202 len: 0 microversion: 2.1 time: 0.507454 May 12 17:53:32.845445 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 595/1196] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 12 17:53:32 2022] POST /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:53:32.927136 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-ab497306-7f0a-41c7-a32e-70662546931a req-e0cde742-5f67-41a2-b14d-2eb75aec6e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49a96bf-7f9d-40ea-a47a-574324e1ea5e", "tag": "fe5c5155-9974-49dd-9f2a-127350bb4e70"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:32.947595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ab497306-7f0a-41c7-a32e-70662546931a req-e0cde742-5f67-41a2-b14d-2eb75aec6e39 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:32.947595 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-ab497306-7f0a-41c7-a32e-70662546931a req-e0cde742-5f67-41a2-b14d-2eb75aec6e39 service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:32.965496 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-ab497306-7f0a-41c7-a32e-70662546931a req-e0cde742-5f67-41a2-b14d-2eb75aec6e39 service nova] Creating event network-changed:fe5c5155-9974-49dd-9f2a-127350bb4e70 for instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e on hv-cinder-83979 May 12 17:53:32.971249 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-ab497306-7f0a-41c7-a32e-70662546931a req-e0cde742-5f67-41a2-b14d-2eb75aec6e39 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121371 May 12 17:53:32.971954 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 602/1197] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:33.973395 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:33.973930 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:33.986616 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:33.987110 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:33.987890 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:33.988323 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:34.033881 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [req-455425a2-4d8b-4f0e-9430-3c8a8c586848 req-7b4b61d6-8c8f-47e1-867d-abad6106a3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49a96bf-7f9d-40ea-a47a-574324e1ea5e", "tag": "fe5c5155-9974-49dd-9f2a-127350bb4e70"}]} {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:34.041898 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-455425a2-4d8b-4f0e-9430-3c8a8c586848 req-7b4b61d6-8c8f-47e1-867d-abad6106a3ec service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:34.042383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [req-455425a2-4d8b-4f0e-9430-3c8a8c586848 req-7b4b61d6-8c8f-47e1-867d-abad6106a3ec service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:34.054310 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.compute.server_external_events [req-455425a2-4d8b-4f0e-9430-3c8a8c586848 req-7b4b61d6-8c8f-47e1-867d-abad6106a3ec service nova] Creating event network-changed:fe5c5155-9974-49dd-9f2a-127350bb4e70 for instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e on hv-cinder-83979 May 12 17:53:34.059419 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [req-455425a2-4d8b-4f0e-9430-3c8a8c586848 req-7b4b61d6-8c8f-47e1-867d-abad6106a3ec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087065 May 12 17:53:34.061497 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 603/1198] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:53:34.074205 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.objects.instance [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lazy-loading 'services' on Instance uuid d49a96bf-7f9d-40ea-a47a-574324e1ea5e {{(pid=123688) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:53:34.152914 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-bc4cfdb9-e818-41c3-8b67-60388765184e tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments/ccc55912-8f79-425c-9f84-5bbe67e2b989" status: 202 len: 0 microversion: 2.1 time: 0.183626 May 12 17:53:34.153899 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 596/1199] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:53:33 2022] DELETE /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments/ccc55912-8f79-425c-9f84-5bbe67e2b989 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:53:34.163130 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-eacb2d84-6cfd-41e0-ab88-6ac38a4ef15d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:34.164589 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-eacb2d84-6cfd-41e0-ab88-6ac38a4ef15d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:34.172552 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eacb2d84-6cfd-41e0-ab88-6ac38a4ef15d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:34.173215 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eacb2d84-6cfd-41e0-ab88-6ac38a4ef15d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:34.174090 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eacb2d84-6cfd-41e0-ab88-6ac38a4ef15d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:34.174831 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-eacb2d84-6cfd-41e0-ab88-6ac38a4ef15d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:34.213555 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-eacb2d84-6cfd-41e0-ab88-6ac38a4ef15d tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054362 May 12 17:53:34.214649 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 604/1200] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:53:34 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:53:35.226558 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-4e818ea4-5594-4279-a02d-26364f8493ca tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:35.227624 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-4e818ea4-5594-4279-a02d-26364f8493ca tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:35.234336 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e818ea4-5594-4279-a02d-26364f8493ca tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:35.234806 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e818ea4-5594-4279-a02d-26364f8493ca tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:35.235566 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e818ea4-5594-4279-a02d-26364f8493ca tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:35.235998 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-4e818ea4-5594-4279-a02d-26364f8493ca tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:35.265274 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-4e818ea4-5594-4279-a02d-26364f8493ca tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043432 May 12 17:53:35.265812 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 597/1201] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 12 17:53:35 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:53:35.275864 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:35.276452 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:35.282954 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:35.283409 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:35.284178 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:35.284616 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:35.358221 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] HTTP exception thrown: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e is not attached to volume ccc55912-8f79-425c-9f84-5bbe67e2b989 May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Request method failure captured: May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: DELETE /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments/ccc55912-8f79-425c-9f84-5bbe67e2b989 HTTP/1.1 May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUkdpTtBp58GlITF2x_oh5ZhbVerxJfzj5dHnqA0seQzgCyf86BW6YDgEGk3Up5R7XyZRCKF0ENJt7i2DmP8Byz4M9_NPvtseyQuKS-32gqmlN-33KF_eXUdJR3NQusu1uHIs11OVgRxCVIVtITHyG4DPtoeJ1GeVKPfTmrhD-kCHYw May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: c3403873c6404cd1a227b411c653126f May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-TestMinimumBasicScenario-1934476569 May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:53:35.365899 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3403873c6404cd1a227b411c653126f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c3403873c6404cd1a227b411c653126f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c3403873c6404cd1a227b411c653126f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3403873c6404cd1a227b411c653126f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-TestMinimumBasicScenario-1934476569 May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: c3403873c6404cd1a227b411c653126f May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1934476569 May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-TestMinimumBasicScenario-1934476569-project May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 6ebf6077df894158babed9db4682d730 May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-TestMinimumBasicScenario-1934476569-project May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:53:35.367679 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e is not attached to volume ccc55912-8f79-425c-9f84-5bbe67e2b989 May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'server_id': 'd49a96bf-7f9d-40ea-a47a-574324e1ea5e', 'id': 'ccc55912-8f79-425c-9f84-5bbe67e2b989'} May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ccc55912-8f79-425c-9f84-5bbe67e2b989. May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:53:35.368630 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e is not attached to volume ccc55912-8f79-425c-9f84-5bbe67e2b989 May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e is not attached to volume ccc55912-8f79-425c-9f84-5bbe67e2b989 May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:35.369998 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Returning 404 to user: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e is not attached to volume ccc55912-8f79-425c-9f84-5bbe67e2b989 {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:53:35.371058 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fa9e08bf-a9e7-4315-bed2-1ffd741a594a tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments/ccc55912-8f79-425c-9f84-5bbe67e2b989" status: 404 len: 154 microversion: 2.1 time: 0.095731 May 12 17:53:35.371058 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 605/1202] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 12 17:53:35 2022] DELETE /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e/os-volume_attachments/ccc55912-8f79-425c-9f84-5bbe67e2b989 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:53:36.498709 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:36.499191 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:36.505418 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:36.505872 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:36.506642 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:36.507118 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:36.531967 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Going to try to terminate instance {{(pid=123688) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:53:36.602990 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-09c00482-e03b-4edc-a614-6f32b46a492f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 204 len: 0 microversion: 2.1 time: 0.107577 May 12 17:53:36.603895 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 598/1203] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 12 17:53:36 2022] DELETE /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:53:36.613442 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:36.614047 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:36.620335 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:36.620778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:36.621533 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:36.621962 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:36.753593 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:36.760818 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-5af75965-d7c9-4491-b3d2-406f3092e925 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1551 microversion: 2.1 time: 0.151245 May 12 17:53:36.761376 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 606/1204] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:53:36 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:37.780019 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:37.780716 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.compute.api [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123688) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:37.787338 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:37.787787 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:37.788555 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:37.788988 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:37.923566 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.policy [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123688) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:37.931107 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-9a4c4112-054a-4ce8-aa1a-1e9466b96faf tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1551 microversion: 2.1 time: 0.156023 May 12 17:53:37.931669 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 599/1205] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:53:37 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:38.948774 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:38.950182 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:38.957902 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:38.958644 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:38.959557 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:38.960072 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:39.043264 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.policy [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebf6077df894158babed9db4682d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3403873c6404cd1a227b411c653126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123689) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:39.050464 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-2d5b336a-74c5-48e7-8ea4-6e6f1d227c3f tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 200 len: 1509 microversion: 2.1 time: 0.106247 May 12 17:53:39.051339 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 607/1206] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:53:38 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 1509 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:39.067521 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [req-352f3961-83a1-4503-9524-d39db0a74f20 req-75e16e48-8299-4a99-b81a-3416b5a6d5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49a96bf-7f9d-40ea-a47a-574324e1ea5e", "name": "network-vif-deleted", "tag": "fe5c5155-9974-49dd-9f2a-127350bb4e70"}]} {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:39.077261 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-352f3961-83a1-4503-9524-d39db0a74f20 req-75e16e48-8299-4a99-b81a-3416b5a6d5ec service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:39.077797 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG oslo_concurrency.lockutils [req-352f3961-83a1-4503-9524-d39db0a74f20 req-75e16e48-8299-4a99-b81a-3416b5a6d5ec service nova] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:39.089351 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.compute.server_external_events [req-352f3961-83a1-4503-9524-d39db0a74f20 req-75e16e48-8299-4a99-b81a-3416b5a6d5ec service nova] Creating event network-vif-deleted:fe5c5155-9974-49dd-9f2a-127350bb4e70 for instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e on hv-cinder-83979 May 12 17:53:39.095605 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [req-352f3961-83a1-4503-9524-d39db0a74f20 req-75e16e48-8299-4a99-b81a-3416b5a6d5ec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031726 May 12 17:53:39.096373 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 600/1207] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 12 17:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:40.066778 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '>' {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:40.067453 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.compute.api [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] [instance: d49a96bf-7f9d-40ea-a47a-574324e1ea5e] Fetching instance by UUID {{(pid=123689) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:40.073678 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:40.074137 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:40.074930 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:40.076001 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG oslo_concurrency.lockutils [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Lock "bf7cff43-fd3d-4e09-b3ee-3e94eb237374" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:40.089056 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.wsgi [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] HTTP exception thrown: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e could not be found. May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Request method failure captured: May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: request: GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e HTTP/1.1 May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept: application/json May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Accept-Encoding: identity May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Connection: close May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Length: 0 May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Content-Type: application/json May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Host: 10.222.0.76 May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Openstack-System-Scope: None May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: User-Agent: python-urllib3/1.26.9 May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Auth-Token: gAAAAABifUkdpTtBp58GlITF2x_oh5ZhbVerxJfzj5dHnqA0seQzgCyf86BW6YDgEGk3Up5R7XyZRCKF0ENJt7i2DmP8Byz4M9_NPvtseyQuKS-32gqmlN-33KF_eXUdJR3NQusu1uHIs11OVgRxCVIVtITHyG4DPtoeJ1GeVKPfTmrhD-kCHYw May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Id: None May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Domain-Name: None May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Identity-Status: Confirmed May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Is-Admin-Project: True May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Id: default May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Domain-Name: Default May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Id: c3403873c6404cd1a227b411c653126f May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Project-Name: tempest-TestMinimumBasicScenario-1934476569 May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Role: member,reader May 12 17:53:40.090571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Roles: member,reader May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3403873c6404cd1a227b411c653126f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c3403873c6404cd1a227b411c653126f", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c3403873c6404cd1a227b411c653126f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3403873c6404cd1a227b411c653126f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant: tempest-TestMinimumBasicScenario-1934476569 May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Id: c3403873c6404cd1a227b411c653126f May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1934476569 May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User: tempest-TestMinimumBasicScenario-1934476569-project May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Id: default May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Domain-Name: Default May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Id: 6ebf6077df894158babed9db4682d730 May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: X-User-Name: tempest-TestMinimumBasicScenario-1934476569-project May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: method: > May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: exception: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e could not be found. May 12 17:53:40.092991 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: action_args: {'id': 'd49a96bf-7f9d-40ea-a47a-574324e1ea5e'} May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: {{(pid=123689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e could not be found. May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:53:40.093904 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e could not be found. May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e could not be found. May 12 17:53:40.095612 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: ERROR nova.api.openstack.wsgi May 12 17:53:40.097064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: DEBUG nova.api.openstack.wsgi [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Returning 404 to user: Instance d49a96bf-7f9d-40ea-a47a-574324e1ea5e could not be found. {{(pid=123689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:53:40.097064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO nova.api.openstack.requestlog [None req-fd0eae95-e46e-4b12-906e-01a8dda8a6c2 tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e" status: 404 len: 111 microversion: 2.1 time: 0.029743 May 12 17:53:40.097064 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: [pid: 123689|app: 0|req: 608/1208] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 12 17:53:40 2022] GET /compute/v2.1/servers/d49a96bf-7f9d-40ea-a47a-574324e1ea5e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:53:40.102184 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: DEBUG nova.api.openstack.wsgi [None req-ec7769a0-89e2-41fc-92a5-bdb76103aa9b tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] Calling method '.version_select at 0x7f24bc36dc10>' {{(pid=123688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:40.119159 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO nova.api.openstack.requestlog [None req-ec7769a0-89e2-41fc-92a5-bdb76103aa9b tempest-TestMinimumBasicScenario-1934476569 tempest-TestMinimumBasicScenario-1934476569-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-7351247" status: 202 len: 0 microversion: 2.1 time: 0.021500 May 12 17:53:40.119716 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: [pid: 123688|app: 0|req: 601/1209] 10.222.0.76 () {58 vars in 1262 bytes} [Thu May 12 17:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-7351247 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:56:12.661055 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:56:12.661787 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Thu May 12 17:56:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:56:16.416979 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:56:16.417604 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Thu May 12 17:56:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:56:22.944571 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:56:22.945118 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Thu May 12 17:56:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:56:31.555702 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:56:31.556385 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Thu May 12 17:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:57:38.850735 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:57:38.851423 dv-cinder-839793-10-iscsi devstack@n-api.service[123688]: Thu May 12 17:57:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:57:50.307383 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:57:50.307803 dv-cinder-839793-10-iscsi devstack@n-api.service[123689]: Thu May 12 17:57:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!